-- Logs begin at Wed 2021-11-10 03:11:39 UTC, end at Wed 2021-11-10 05:24:27 UTC. -- Nov 10 03:48:16.863686 ncdv-817176-1 systemd[1]: Started Devstack devstack@c-vol.service. Nov 10 03:48:20.133178 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 10 03:48:20.133178 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=127670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 10 03:48:20.531103 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-da004931-ee1f-47e4-800f-d76113177080 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:48:20.757940 ncdv-817176-1 cinder-volume[127670]: INFO cinder.rpc [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 10 03:48:20.762921 ncdv-817176-1 cinder-volume[127670]: INFO cinder.rpc [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 10 03:48:20.770002 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-da004931-ee1f-47e4-800f-d76113177080 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:48:20.840754 ncdv-817176-1 cinder-volume[127670]: INFO cinder.volume.manager [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Determined volume DB was empty at startup. Nov 10 03:48:20.841375 ncdv-817176-1 cinder-volume[127670]: DEBUG cinder.volume.manager [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=127670) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Nov 10 03:48:20.849478 ncdv-817176-1 cinder-volume[127670]: INFO cinder.volume.manager [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 10 03:48:20.850262 ncdv-817176-1 cinder-volume[127670]: WARNING stevedore.named [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 03:48:20.850748 ncdv-817176-1 cinder-volume[127670]: WARNING castellan.key_manager [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:48:20.851887 ncdv-817176-1 cinder-volume[127670]: WARNING cinder.keymgr.conf_key_mgr [None req-da004931-ee1f-47e4-800f-d76113177080 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:48:20.869333 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-da004931-ee1f-47e4-800f-d76113177080 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:48:20.873732 ncdv-817176-1 cinder-volume[127670]: INFO cinder.rpc [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 10 03:48:20.878613 ncdv-817176-1 cinder-volume[127670]: INFO cinder.rpc [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Nov 10 03:48:20.879550 ncdv-817176-1 cinder-volume[127670]: WARNING stevedore.named [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 03:48:20.880602 ncdv-817176-1 cinder-volume[127670]: WARNING castellan.key_manager [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:48:20.882391 ncdv-817176-1 cinder-volume[127670]: INFO cinder.volume.manager [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Image-volume cache enabled for host ncdv-817176-1@ceph. Nov 10 03:48:20.887827 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_db.sqlalchemy.engines [None req-da004931-ee1f-47e4-800f-d76113177080 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:48:20.908543 ncdv-817176-1 cinder-volume[127670]: INFO oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Starting 1 workers Nov 10 03:48:20.916757 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Started child 127842 {{(pid=127670) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 10 03:48:20.916757 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Full set of CONF: {{(pid=127670) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 10 03:48:20.916757 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ******************************************************************************** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 10 03:48:20.916757 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] Configuration options gathered from: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 10 03:48:20.916757 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 10 03:48:20.916757 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 10 03:48:20.917398 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ================================================================================ {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 10 03:48:20.918675 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] allow_availability_zone_fallback = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.918675 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] allow_compression_on_image_upload = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.918873 ncdv-817176-1 cinder-volume[127842]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Nov 10 03:48:20.919397 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] allowed_direct_url_schemes = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.919999 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] api_rate_limit = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.920538 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] auth_strategy = keystone {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.921089 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] az_cache_duration = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.921577 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_availability_zone = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.922052 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_host = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.923191 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.923191 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_stats_polling_interval = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.923467 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backup_api_class = cinder.backup.api.API {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.923947 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.924433 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backup_name_template = backup-%s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.924922 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backup_use_same_host = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.925388 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backup_use_temp_snapshot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.925850 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] chap_password = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.926337 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] chap_username = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.926820 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.927346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_internal_tenant_project_id = 965b7da990b947c19ba74a09cc22832f {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.927836 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_internal_tenant_user_id = 7e779dee8d114aa890e1725ef72b0ac7 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.928308 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cloned_volume_same_az = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.928800 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cluster = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.929301 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] compression_format = gzip {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.930128 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] compute_api_class = cinder.compute.nova.API {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.930532 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] config_dir = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.930941 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.931442 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] config_source = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.931931 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.932433 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] control_exchange = openstack {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.932966 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] debug = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.939990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] default_availability_zone = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.939990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] default_group_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.939990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.939990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] default_volume_type = ceph {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.939990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] driver_client_cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] driver_client_cert_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] driver_data_namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] driver_ssl_cert_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] driver_ssl_cert_verify = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] driver_use_ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] enable_force_upload = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] enable_new_services = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943726 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] enable_unsupported_driver = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943726 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] enabled_backends = ['ceph'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.943726 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] enforce_multipath_for_image_xfer = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.944026 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] filter_function = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.944471 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_api_insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.945240 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_api_servers = ['http://10.222.0.13/image'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.947248 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_api_ssl_compression = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.947248 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_ca_certificates_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.947248 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_catalog_info = image:glance:publicURL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.947248 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.947594 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.947936 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.948348 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_num_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.948782 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] glance_request_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.949216 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] goodness_function = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.949688 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] graceful_shutdown_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.950237 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] group_api_class = cinder.group.api.API {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.950592 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] host = ncdv-817176-1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.951029 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iet_conf = /etc/iet/ietd.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.951458 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_compress_on_upload = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.951887 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_conversion_address_space_limit = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.952301 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_conversion_cpu_limit = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.952884 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.953299 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_upload_use_cinder_backend = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.953724 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_upload_use_internal_tenant = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.954136 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_volume_cache_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.954550 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_volume_cache_max_count = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.954913 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Starting volume driver RBDDriver (1.2.0) Nov 10 03:48:20.955018 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] image_volume_cache_max_size_gb = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.955405 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] init_host_max_objects_retrieval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.955842 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] instance_format = [instance: %(uuid)s] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.956275 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.956648 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:20.956760 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iscsi_iotype = fileio {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.957184 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iscsi_secondary_ip_addresses = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.957601 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iscsi_target_flags = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.958664 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iscsi_write_cache = on {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.959061 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iser_helper = tgtadm {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.959717 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iser_ip_address = 10.222.0.13 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.960211 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iser_port = 3260 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.960674 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.961097 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_config_append = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.961524 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.961937 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.962354 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.962707 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_options = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.963123 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_rotate_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.963576 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_rotate_interval_type = days {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.964017 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] log_rotation_type = none {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.964389 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.964766 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.965188 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.965627 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.965978 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.966917 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] max_age = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.966917 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] max_logfile_count = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.967103 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] max_logfile_size_mb = 200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.967578 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] max_over_subscription_ratio = 20.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.968042 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] message_reap_interval = 86400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.968523 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] message_ttl = 2592000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.971458 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] migration_create_volume_timeout_secs = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.971458 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] monkey_patch = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.971458 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] monkey_patch_modules = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.971759 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] my_ip = 10.222.0.13 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.972108 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] no_snapshot_gb_quota = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.972633 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] num_iser_scan_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.973052 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] num_shell_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.973708 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] num_volume_device_scan_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.974282 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] nvmet_ns_id = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.974959 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] nvmet_port_id = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.975563 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_max_limit = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.976151 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_volume_ext_list = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.976754 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.977343 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_volume_listen = 0.0.0.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.977867 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_volume_listen_port = 8776 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.978370 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_volume_use_ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.978895 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] osapi_volume_workers = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.979389 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] per_volume_size_limit = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.979908 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] periodic_fuzzy_delay = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.980443 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] periodic_interval = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.980990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] public_endpoint = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.981490 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] publish_errors = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.982163 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_backup_gigabytes = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.982657 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_backups = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.983326 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_consistencygroups = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.983693 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.984106 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_gigabytes = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.984660 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_groups = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.985014 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_snapshots = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.985383 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] quota_volumes = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.985734 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] rate_limit_burst = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.986651 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] rate_limit_except_level = CRITICAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.986651 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] rate_limit_interval = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.986834 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] reinit_driver_count = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.987127 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] replication_device = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.987479 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] report_discard_supported = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.987850 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] report_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.988322 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] reservation_clean_interval = 86400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.988633 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] reservation_expire = 86400 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.989531 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] reserved_percentage = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.989943 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.990324 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.990714 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] rpc_response_timeout = 120 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.991064 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] run_external_periodic_tasks = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.991420 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.991797 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] scst_target_driver = iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.992133 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] scst_target_iqn_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.992683 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_down_time = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.993218 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] snapshot_name_template = snapshot-%s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.994416 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] snapshot_same_host = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.995353 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.996169 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] state_path = /opt/stack/data/cinder {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.996887 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] storage_availability_zone = nova {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.997496 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] storage_protocol = iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.998026 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] syslog_log_facility = LOG_USER {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.998544 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] target_helper = lioadm {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.999148 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] target_ip_address = 10.222.0.13 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:20.999650 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] target_port = 3260 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.000169 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.000718 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] target_protocol = iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.001241 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] trace_flags = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.001776 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] transfer_api_class = cinder.transfer.api.API {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.002277 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] transport_url = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.003082 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] until_refresh = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.003602 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_chap_auth = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.004117 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_default_quota_class = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.005414 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_eventlog = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.005965 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_journal = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.006590 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_json = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.007095 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_multipath_for_image_xfer = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.007618 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_stderr = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.008737 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] use_syslog = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.009977 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] verify_glance_signatures = enabled {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.010516 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_api_class = cinder.volume.api.API {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.011021 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_backend_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.011565 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_clear = zero {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.012063 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_clear_ionice = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.012570 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_clear_size = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.013367 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.014444 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_copy_bps_limit = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.014976 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_dd_blocksize = 1M {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.015516 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.016140 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_name_template = volume-%s {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.016807 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_service_inithost_offload = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.017339 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volume_usage_audit_period = month {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.017965 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.018503 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] watch_log_file = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.019041 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] zoning_mode = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 10 03:48:21.019657 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.020251 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.enforce_new_defaults = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.023660 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:21.029502 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.enforce_scope = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.030108 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.policy_default_rule = default {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.030590 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.031094 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.policy_file = policy.yaml {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.031565 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.032041 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.032469 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.033092 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.033733 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.034490 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_concurrency.disable_process_locking = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.034950 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.035458 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.admin_password = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.035977 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.036526 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.admin_token = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.036980 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.admin_user = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.037418 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_admin_prefix = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.037849 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.038326 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_port = 35357 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.038782 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_protocol = https {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.039286 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.039994 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_type = password {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.042228 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.042828 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.auth_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.043783 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.cache = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.044439 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.044992 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.045506 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.delay_auth_decision = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.046063 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.046693 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.http_connect_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.054459 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.057770 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.identity_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.058784 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.include_service_catalog = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.059175 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.059575 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.interface = public {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.059954 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.060329 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.060725 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.061096 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.062397 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.062772 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.063154 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.063705 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.064413 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.065051 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.065576 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.066026 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:21.066306 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.066963 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.service_token_roles_required = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.068045 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.service_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.068587 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.token_cache_time = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.069153 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.069800 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.backend = dogpile.cache.null {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.070610 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.backend_argument = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.071153 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.config_prefix = cache.oslo {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.071888 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.debug_cache_backend = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.072441 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.073010 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.expiration_time = 600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.073541 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_dead_retry = 300 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.074075 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.074813 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.075359 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_pool_maxsize = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.075880 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.076461 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.077184 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.memcache_socket_timeout = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.077733 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.proxies = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.078292 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.tls_allowed_ciphers = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.078824 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.tls_cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.079371 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.tls_certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.079746 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.tls_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.080264 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cache.tls_keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.080713 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] coordination.backend_url = etcd3+http://10.222.0.13:2379 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.081161 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.backend = sqlalchemy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.082127 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.083103 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.connection_debug = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.083865 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.connection_parameters = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.084390 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.connection_recycle_time = 3600 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.085238 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.connection_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.085605 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.db_inc_retry_interval = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.085975 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.db_max_retries = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.086360 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.db_max_retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.086720 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.db_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.087237 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.max_overflow = 50 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.087602 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.max_pool_size = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.087965 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.max_retries = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.088540 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.mysql_enable_ndb = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.088942 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.089306 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.pool_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.089669 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.retry_interval = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.090038 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.slave_connection = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.090581 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.sqlite_synchronous = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.090940 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] database.use_db_reconnect = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.091334 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.091697 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.092243 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.092946 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.093532 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.094121 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.connection_string = messaging:// {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.094603 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.095453 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.es_doc_type = notification {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.097308 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.es_scroll_size = 10000 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.097984 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.es_scroll_time = 2m {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.098887 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.filter_error_trace = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.099427 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.hmac_keys = SECRET_KEY {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.099960 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.sentinel_service_name = mymaster {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.100478 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.socket_timeout = 0.1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.101023 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] profiler.trace_sqlalchemy = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.101616 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] privsep_osbrick.capabilities = [21] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.102758 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] privsep_osbrick.group = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.103463 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] privsep_osbrick.helper_command = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.103835 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.104244 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.104656 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] privsep_osbrick.user = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.105047 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.105599 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_sys_admin.group = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.105951 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_sys_admin.helper_command = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.106329 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.107974 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.108349 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] cinder_sys_admin.user = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.108771 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.109139 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.109499 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.109851 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.110242 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.110597 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.110945 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.111297 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.send_service_user_token = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.111656 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.112351 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] service_user.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.112565 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.driver [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Driver hasn't implemented _init_vendor_properties() Nov 10 03:48:21.112808 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.backend_availability_zone = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.113197 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.113553 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.113879 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.driver [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:9b83638b-82ec-4601-b6df-16c5dc5750ec:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=127842) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Nov 10 03:48:21.114538 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.chap_password = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.114823 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.chap_username = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.115193 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.115742 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.116114 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.116454 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.driver_client_cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.116845 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.driver_client_cert_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.117208 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.driver_data_namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.117728 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.118088 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.118441 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.driver_use_ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.118800 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.enable_deferred_deletion = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.119150 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.enable_unsupported_driver = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.119501 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.119903 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.extra_capabilities = {} {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.120248 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.filter_function = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.120593 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.goodness_function = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.121012 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.121371 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.121731 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.122088 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.122669 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.123024 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.123396 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iscsi_iotype = fileio {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.123771 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.124142 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iscsi_target_flags = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.124521 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iscsi_write_cache = on {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.124925 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iser_helper = tgtadm {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.125471 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iser_ip_address = 10.222.0.13 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.126011 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iser_port = 3260 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.126414 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.126774 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.127129 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.127482 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.num_shell_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.128003 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.128367 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.128745 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.nvmet_port_id = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.129108 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.129465 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rados_connection_interval = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.130511 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rados_connection_retries = 3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.130886 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_ceph_conf = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.131247 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.131601 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.131965 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.132453 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.132930 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_pool = rbd {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.133298 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_secret_uuid = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.133848 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.133972 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.rbd_user = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.134504 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.135000 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.replication_device = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.135506 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.report_discard_supported = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.136243 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.136597 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.reserved_percentage = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.136991 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.scst_target_driver = iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.137411 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.scst_target_iqn_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.137897 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.storage_protocol = iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.138412 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.139042 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.target_helper = tgtadm {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.139836 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.target_ip_address = 10.222.0.13 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.140360 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.target_port = 3260 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.140772 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.141147 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.target_protocol = iscsi {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.141500 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.trace_flags = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.141862 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.unique_fqdn_network = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.142218 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.use_chap_auth = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.142582 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.142968 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_backend_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.143351 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_clear = zero {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.143737 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_clear_ionice = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.144099 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_clear_size = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.144468 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.145424 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:48:21.145577 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.145823 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.146521 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.147181 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.147587 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_reports.file_event_handler = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.148011 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.148393 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_reports.log_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.148814 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.backend_availability_zone = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.149322 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.backend_host = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.149841 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.backend_native_threads_pool_size = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.150360 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.backup_use_temp_snapshot = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.151204 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.chap_password = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.151706 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.chap_username = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.152392 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.chiscsi_conf = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.152954 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.deferred_deletion_delay = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.154109 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.deferred_deletion_purge_interval = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.154695 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.driver_client_cert = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.155312 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.driver_client_cert_key = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.155843 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.driver_data_namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.156585 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.driver_ssl_cert_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.157155 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.driver_ssl_cert_verify = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.157653 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.driver_use_ssl = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.158141 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.enable_deferred_deletion = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.158667 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.enable_unsupported_driver = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.159167 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.159664 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.extra_capabilities = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.160141 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.filter_function = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.160783 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.goodness_function = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.161445 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iet_conf = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.162025 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.image_upload_use_cinder_backend = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.163616 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.image_upload_use_internal_tenant = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.164464 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.image_volume_cache_enabled = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.165059 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.image_volume_cache_max_count = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.165582 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.166146 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iscsi_iotype = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.167813 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.168343 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iscsi_target_flags = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.168975 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iscsi_write_cache = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iser_helper = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iser_ip_address = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iser_port = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.iser_target_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.max_over_subscription_ratio = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.num_iser_scan_tries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.171768 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.num_shell_tries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.172598 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.num_volume_device_scan_tries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.173144 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.nvmet_ns_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.173677 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.nvmet_port_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.174221 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rados_connect_timeout = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.174735 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rados_connection_interval = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.175369 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rados_connection_retries = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.175965 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.177073 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_cluster_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.178767 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.181176 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.181898 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_max_clone_depth = 5 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.183583 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_pool = volumes {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.184298 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_secret_uuid = c273726b-b05d-457f-ba23-7fd03d313f37 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.185018 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_store_chunk_size = 4 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.185702 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.rbd_user = cinder {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.186292 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.replication_connect_timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.188213 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.replication_device = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.189361 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.report_discard_supported = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.189974 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.report_dynamic_total_capacity = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.190559 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.reserved_percentage = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.191148 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.scst_target_driver = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.191735 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.scst_target_iqn_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.193160 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.storage_protocol = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.193868 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.194541 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.target_helper = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.195498 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.target_ip_address = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.196847 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.target_port = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.197452 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.target_prefix = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.198081 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.target_protocol = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.198663 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.trace_flags = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.199629 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.unique_fqdn_network = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.200214 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.use_chap_auth = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.200845 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.use_multipath_for_image_xfer = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.201452 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_backend_name = ceph {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.202015 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_clear = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.202584 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_clear_ionice = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.203174 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_clear_size = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.203866 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.204397 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_copy_bps_limit = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.205099 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_dd_blocksize = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.205709 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.206291 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ceph.volumes_dir = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.206734 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.db.sqlalchemy.api [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Building query based on filter {{(pid=127842) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3141}} Nov 10 03:48:21.207261 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.208990 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.209775 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.210521 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.211128 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.211738 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.212532 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.215346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.215346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.215346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.215346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.215346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.215346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.216022 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.216022 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.216479 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.217034 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.217999 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.217999 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.218641 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.219254 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.219959 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.220473 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.221042 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.221568 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.222084 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_rabbit.ssl_version = {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.222582 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_notifications.driver = [] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.223097 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_notifications.retry = -1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.224163 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.224876 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] oslo_messaging_notifications.transport_url = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.225955 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.230142 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=127842) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Nov 10 03:48:21.231157 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] key_manager.fixed_key = **** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.231840 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.232277 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.barbican_api_version = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.232670 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.barbican_endpoint = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.233233 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.barbican_endpoint_type = public {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.233635 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.barbican_region_name = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.234231 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.234797 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.235167 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.235533 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.235986 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.236942 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.number_of_retries = 60 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.237493 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.retry_delay = 1 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.238671 ncdv-817176-1 cinder-volume[127842]: INFO cinder.keymgr.migration [None req-039d599e-fa8d-4834-8997-f98a2b537fa5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 10 03:48:21.239686 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.send_service_user_token = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.240949 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.241092 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.241465 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.verify_ssl = True {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.241831 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican.verify_ssl_path = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.242204 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.auth_section = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.242571 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.auth_type = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.242968 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.244526 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.245346 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.245895 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.246512 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.246880 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.247244 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] barbican_service_user.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.247699 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.approle_role_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.248061 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.approle_secret_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.248417 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.cafile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.248826 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.certfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.249979 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.collect_timing = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.250508 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.insecure = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.251116 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.keyfile = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.251683 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.kv_mountpoint = secret {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.252240 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.kv_version = 2 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.252688 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.namespace = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.253349 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.root_token_id = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.255280 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:21.255916 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.split_loggers = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.256332 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.ssl_ca_crt_file = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.257014 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.timeout = None {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.257176 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.use_ssl = False {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.257719 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 10 03:48:21.258015 ncdv-817176-1 cinder-volume[127670]: DEBUG oslo_service.service [None req-da004931-ee1f-47e4-800f-d76113177080 None None] ******************************************************************************** {{(pid=127670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 10 03:48:21.285299 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:21.318019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:48:21.354918 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Driver initialization completed successfully. Nov 10 03:48:21.362681 ncdv-817176-1 cinder-volume[127842]: INFO cinder.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Initiating service 3 cleanup Nov 10 03:48:21.368839 ncdv-817176-1 cinder-volume[127842]: INFO cinder.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Service 3 cleanup completed. Nov 10 03:48:21.369180 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.service [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Creating RPC server for service cinder-volume {{(pid=127842) start /opt/stack/cinder/cinder/service.py:231}} Nov 10 03:48:21.375338 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.service [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=127842) start /opt/stack/cinder/cinder/service.py:237}} Nov 10 03:48:21.455635 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Nov 10 03:48:21.456648 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:21.484651 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:48:21.536829 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fbcc6de3-4855-4d91-8ff3-fe76daa21b94 None None] Driver post RPC initialization completed successfully. Nov 10 03:49:28.541374 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:49:28.542223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:49:28.563946 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:49:28.587976 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:50:28.543586 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:50:28.545063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:50:28.566715 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:50:28.589489 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:51:28.544589 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:51:28.545621 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:51:28.568449 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:51:28.590223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:52:28.545329 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:52:28.546406 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:52:28.567552 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:52:28.588870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:53:28.544050 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:53:28.544753 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:53:28.565554 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:53:28.588070 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:54:28.542868 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:54:28.543569 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:54:28.564191 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:54:28.588122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:55:28.542678 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:55:28.543333 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:55:28.565566 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:55:28.587427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:56:28.542243 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:56:28.542995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:56:28.579938 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:56:28.607808 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:57:28.544648 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:57:28.545374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:57:28.632208 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:57:28.706859 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:58:09.970415 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 03:58:09.985443 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:58:09.999633 ncdv-817176-1 cinder-volume[127842]: INFO cinder.rpc [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Nov 10 03:58:10.012731 ncdv-817176-1 cinder-volume[127842]: INFO cinder.rpc [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Nov 10 03:58:10.014211 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 03:58:10.016372 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:58:10.101953 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (117c16c7-201e-4fea-9664-ef2ce282f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:10.106679 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bfd1bf-83bc-4119-9651-544f78572098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:10.114759 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:58:10.182349 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bfd1bf-83bc-4119-9651-544f78572098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T03:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-754470821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=d9503646-2c1b-46f1-9bbe-418ef20ac849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44752ec82c74a28aa4dac2a2f8f88d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T03:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T03:58:10Z,use_quota=True,user_id='18d81f586d0a4e8ea083ba207b9f905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:10.187677 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc543821-361c-4e85-b632-dd2635a1999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:10.190821 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc543821-361c-4e85-b632-dd2635a1999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:10.195564 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6033b560-1311-471a-bd7c-de5550c448c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:10.324284 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6033b560-1311-471a-bd7c-de5550c448c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9503646-2c1b-46f1-9bbe-418ef20ac849', 'volume_name': 'volume-d9503646-2c1b-46f1-9bbe-418ef20ac849', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:10.327540 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67233535-9dd0-434e-befd-5ec75a875783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:10.330215 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67233535-9dd0-434e-befd-5ec75a875783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:10.332907 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a097ca-7305-492c-af17-d40929c69c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:10.334208 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume d9503646-2c1b-46f1-9bbe-418ef20ac849: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9503646-2c1b-46f1-9bbe-418ef20ac849', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 03:58:10.336477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Cloning d9503646-2c1b-46f1-9bbe-418ef20ac849 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 03:58:10.360182 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 03:58:10.370460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Preparing cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:875}} Nov 10 03:58:10.372095 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 03:58:28.216171 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph, size 616.00 MB, duration 17.84 sec {{(pid=127842) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Nov 10 03:58:28.222408 ncdv-817176-1 cinder-volume[127842]: INFO cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Image download 616.00 MB at 34.53 MB/s Nov 10 03:58:28.296449 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:28.546873 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:58:28.550070 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:28.579994 ncdv-817176-1 sudo[137680]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph Nov 10 03:58:28.582725 ncdv-817176-1 sudo[137680]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 10 03:58:28.658277 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:28.727729 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 03:58:29.824931 ncdv-817176-1 sudo[137680]: pam_unix(sudo:session): session closed for user root Nov 10 03:58:29.829020 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph" returned: 0 in 1.532s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:29.833306 ncdv-817176-1 cinder-volume[127842]: WARNING py.warnings [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:70: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 10 03:58:29.833306 ncdv-817176-1 cinder-volume[127842]: debtcollector.deprecate( Nov 10 03:58:29.833306 ncdv-817176-1 cinder-volume[127842]: Nov 10 03:58:29.835254 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Temporary image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f is fetched for user 18d81f586d0a4e8ea083ba207b9f905e. {{(pid=127842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Nov 10 03:58:29.927906 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:30.223730 ncdv-817176-1 sudo[137734]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph Nov 10 03:58:30.224525 ncdv-817176-1 sudo[137734]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 10 03:58:30.929119 ncdv-817176-1 sudo[137734]: pam_unix(sudo:session): session closed for user root Nov 10 03:58:30.931741 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph" returned: 0 in 1.003s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:30.933480 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] creating volume 'volume-d9503646-2c1b-46f1-9bbe-418ef20ac849' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 03:58:30.934968 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:31.110536 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 03:58:31.111184 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 03:58:31.166810 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Attempting download of 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f ((None, None)) to volume d9503646-2c1b-46f1-9bbe-418ef20ac849. {{(pid=127842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Nov 10 03:58:31.224223 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_xg87_vqd {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:31.384161 ncdv-817176-1 sudo[137763]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_xg87_vqd Nov 10 03:58:31.385786 ncdv-817176-1 sudo[137763]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 10 03:58:31.973890 ncdv-817176-1 sudo[137763]: pam_unix(sudo:session): session closed for user root Nov 10 03:58:31.976309 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_xg87_vqd" returned: 0 in 0.752s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:31.977680 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:32.197285 ncdv-817176-1 sudo[137767]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph Nov 10 03:58:32.198205 ncdv-817176-1 sudo[137767]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 10 03:58:32.901811 ncdv-817176-1 sudo[137767]: pam_unix(sudo:session): session closed for user root Nov 10 03:58:32.906655 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph" returned: 0 in 0.929s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:32.908059 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f was vhdx, converting to raw {{(pid=127842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Nov 10 03:58:32.909960 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph /opt/stack/data/cinder/conversion/tmpw1iwpd4g {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:32.978402 ncdv-817176-1 sudo[137772]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph /opt/stack/data/cinder/conversion/tmpw1iwpd4g Nov 10 03:58:32.983249 ncdv-817176-1 sudo[137772]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 10 03:58:34.849646 ncdv-817176-1 sudo[137772]: pam_unix(sudo:session): session closed for user root Nov 10 03:58:34.851897 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph /opt/stack/data/cinder/conversion/tmpw1iwpd4g" returned: 0 in 1.942s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:34.853253 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:34.986682 ncdv-817176-1 sudo[137787]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph Nov 10 03:58:34.987573 ncdv-817176-1 sudo[137787]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 10 03:58:35.806164 ncdv-817176-1 sudo[137787]: pam_unix(sudo:session): session closed for user root Nov 10 03:58:35.808899 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph" returned: 0 in 0.955s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:35.809610 ncdv-817176-1 cinder-volume[127842]: WARNING py.warnings [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:70: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 10 03:58:35.809610 ncdv-817176-1 cinder-volume[127842]: debtcollector.deprecate( Nov 10 03:58:35.809610 ncdv-817176-1 cinder-volume[127842]: Nov 10 03:58:35.810227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b27f3d4-e333-4e06-a4b0-5e41ac7d127f_74asme8zncdv-817176-1@ceph, size 700.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/conversion/tmpw1iwpd4g {{(pid=127842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Nov 10 03:58:35.810619 ncdv-817176-1 cinder-volume[127842]: INFO cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Converted 700.00 MB image at 360.23 MB/s Nov 10 03:58:35.812010 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:35.950034 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 03:58:35.957317 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 03:58:35.996638 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] deleting rbd volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 03:58:36.509616 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpw1iwpd4g volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:58:42.367568 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpw1iwpd4g volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.858s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:58:42.530072 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:42.693772 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 03:58:42.694161 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 03:58:42.695583 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Downloaded image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f ((None, None)) to volume d9503646-2c1b-46f1-9bbe-418ef20ac849 successfully. {{(pid=127842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Nov 10 03:58:42.774029 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Temporary image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f for user 18d81f586d0a4e8ea083ba207b9f905e is deleted. {{(pid=127842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Nov 10 03:58:42.871716 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 10 03:58:42.872635 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 10 03:58:43.034285 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Created reservations ['4cc49d25-dda9-4023-8b61-98117f112d1a', '1dab0a1f-5331-4bc4-8749-6417d4c27e91', '8cb397a0-5e8a-45ea-8544-ed9d0b1ab8ad', 'eeb0df31-80d8-4fc3-af02-d9852d11c97c'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 03:58:43.055689 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Creating image volume entry: {'group_id': None, 'provider_id': None, 'display_description': None, 'launched_at': None, 'display_name': 'image-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_admin_metadata': [], 'deleted': False, 'user_id': '18d81f586d0a4e8ea083ba207b9f905e', 'shared_targets': True, 'replication_status': None, 'project_id': '965b7da990b947c19ba74a09cc22832f', 'terminated_at': None, 'metadata': {}, 'host': 'ncdv-817176-1@ceph#ceph', 'service_uuid': None, 'scheduled_at': datetime.datetime(2021, 11, 10, 3, 58, 10, tzinfo=datetime.timezone.utc), 'provider_location': None, 'size': 1, 'ec2_id': None, 'multiattach': False, 'bootable': False, 'encryption_key_id': None, 'provider_geometry': None, 'cluster_name': None, 'created_at': datetime.datetime(2021, 11, 10, 3, 58, 9, tzinfo=datetime.timezone.utc), 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'volume_metadata': [], 'availability_zone': 'nova', 'deleted_at': None, 'provider_auth': None, 'replication_driver_data': None, 'volume_type_id': '5acb72e9-5d43-4875-ad21-a683c04fb820', 'consistencygroup_id': None, 'replication_extended_status': None, 'updated_at': datetime.datetime(2021, 11, 10, 3, 58, 10, tzinfo=datetime.timezone.utc), 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'd9503646-2c1b-46f1-9bbe-418ef20ac849'}. {{(pid=127842) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Nov 10 03:58:43.179906 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume reschedule parameters: False retry: None {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 03:58:43.186061 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 03:58:43.186569 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:58:43.200678 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (6e5ec8c1-f224-47da-9abb-686c2265074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:43.204398 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170fa00b-2f53-4ce4-a0b0-e78d3ad2bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:43.210829 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:58:43.228106 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170fa00b-2f53-4ce4-a0b0-e78d3ad2bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T03:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='image-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=583b8721-484c-4bfe-b14f-b4e8b32b6700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965b7da990b947c19ba74a09cc22832f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T03:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d9503646-2c1b-46f1-9bbe-418ef20ac849,status='creating',terminated_at=None,updated_at=2021-11-10T03:58:10Z,use_quota=True,user_id='18d81f586d0a4e8ea083ba207b9f905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:43.231959 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd5ca12-4899-4ef0-ae88-bba2a5cd49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:43.234611 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd5ca12-4899-4ef0-ae88-bba2a5cd49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:43.237464 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e612cd0-e2b1-4d89-918e-6b80640a05e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:43.270998 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e612cd0-e2b1-4d89-918e-6b80640a05e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'volume_name': 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700', 'volume_size': 1, 'source_volid': 'd9503646-2c1b-46f1-9bbe-418ef20ac849', 'source_volstatus': 'downloading'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:43.273590 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ad4772-07a5-4acc-bd35-d1d9a86993bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:43.284047 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ad4772-07a5-4acc-bd35-d1d9a86993bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:43.287249 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda3a916-10a3-4a8b-87ae-4c9f66a9823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:43.288337 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume 583b8721-484c-4bfe-b14f-b4e8b32b6700: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700', 'volume_size': 1, 'source_volid': 'd9503646-2c1b-46f1-9bbe-418ef20ac849', 'source_volstatus': 'downloading'} Nov 10 03:58:43.305268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:43.394106 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] creating snapshot='volume-583b8721-484c-4bfe-b14f-b4e8b32b6700.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 03:58:44.236072 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] cloning 'volume-d9503646-2c1b-46f1-9bbe-418ef20ac849@volume-583b8721-484c-4bfe-b14f-b4e8b32b6700.clone_snap' to 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 03:58:44.382012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 03:58:44.383622 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 03:58:44.384508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 03:58:44.416339 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 03:58:44.419233 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda3a916-10a3-4a8b-87ae-4c9f66a9823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700', 'volume_size': 1, 'source_volid': 'd9503646-2c1b-46f1-9bbe-418ef20ac849', 'source_volstatus': 'downloading'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:44.422200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74147768-c1ad-4ab1-9cf7-49af8a34ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:44.441840 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-583b8721-484c-4bfe-b14f-b4e8b32b6700 (583b8721-484c-4bfe-b14f-b4e8b32b6700): created successfully Nov 10 03:58:44.447791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74147768-c1ad-4ab1-9cf7-49af8a34ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:44.469922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (6e5ec8c1-f224-47da-9abb-686c2265074e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:44.492382 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Created volume successfully. Nov 10 03:58:44.562392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Creating new image-volume cache entry for image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on ncdv-817176-1@ceph#ceph {{(pid=127842) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Nov 10 03:58:44.576870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] New image-volume cache entry created: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 3, 58, 44, 567788)}. {{(pid=127842) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Nov 10 03:58:44.586212 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 34.226s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 03:58:44.589214 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Marking volume d9503646-2c1b-46f1-9bbe-418ef20ac849 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 03:58:44.608562 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to d9503646-2c1b-46f1-9bbe-418ef20ac849. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 03:58:44.610257 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Creating volume glance metadata for volume d9503646-2c1b-46f1-9bbe-418ef20ac849 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 03:58:44.684464 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a097ca-7305-492c-af17-d40929c69c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9503646-2c1b-46f1-9bbe-418ef20ac849', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:44.688541 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a272e1f5-e3a6-4dbb-bbab-b0269922b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:44.699794 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 (d9503646-2c1b-46f1-9bbe-418ef20ac849): created successfully Nov 10 03:58:44.702975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a272e1f5-e3a6-4dbb-bbab-b0269922b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:44.707578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (117c16c7-201e-4fea-9664-ef2ce282f139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:44.719793 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f6769f2c-d89f-4a5f-87f1-30a47a516c22 tempest-TaggedBootDevicesTest-2048337972 None] Created volume successfully. Nov 10 03:58:45.624725 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 03:58:45.631597 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 03:58:45.632367 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:58:45.649536 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (2b25aa2f-0d60-461f-8cff-bb46049853cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:45.653215 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c8ad97-f0f9-4667-929a-c1736456ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:45.661862 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:58:45.680429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c8ad97-f0f9-4667-929a-c1736456ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T03:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1667108835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=9a0d099e-a73e-44e8-8262-6ad489bf17e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44752ec82c74a28aa4dac2a2f8f88d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T03:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T03:58:46Z,use_quota=True,user_id='18d81f586d0a4e8ea083ba207b9f905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:45.685401 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc515fc-c245-4e44-b582-beff9b1ec262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:45.690781 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc515fc-c245-4e44-b582-beff9b1ec262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:45.694921 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f7356b-b7c9-45dd-8074-ac37fa3b0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:45.699647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f7356b-b7c9-45dd-8074-ac37fa3b0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'volume_name': 'volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:45.702519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1965a6-dc2e-4bf3-86f3-a7c12a2068ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:45.705484 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1965a6-dc2e-4bf3-86f3-a7c12a2068ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:45.709926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a750ec-c985-4167-9255-364086304b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:45.712023 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Volume 9a0d099e-a73e-44e8-8262-6ad489bf17e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'volume_size': 1} Nov 10 03:58:45.712668 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] creating volume 'volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 03:58:45.723687 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:45.861471 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 03:58:45.861865 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 03:58:45.863844 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a750ec-c985-4167-9255-364086304b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:45.866012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9e663d-6723-4086-b3cc-78270d59212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:45.887082 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6 (9a0d099e-a73e-44e8-8262-6ad489bf17e6): created successfully Nov 10 03:58:45.889058 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9e663d-6723-4086-b3cc-78270d59212d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:45.891884 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (2b25aa2f-0d60-461f-8cff-bb46049853cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:45.902140 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-eacd11eb-e5e3-4d4c-a8f3-2f800d6a0846 tempest-TaggedBootDevicesTest-2048337972 None] Created volume successfully. Nov 10 03:58:47.249720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 03:58:47.258087 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 03:58:47.258087 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 03:58:47.286927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (6cc1ef1c-eefd-4d02-8356-d1db37a0b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:47.290174 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076102b2-2eb8-44a7-97aa-6c02aba6ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:47.298759 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 03:58:47.332456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076102b2-2eb8-44a7-97aa-6c02aba6ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T03:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1350567992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=c41b9c83-4795-4424-b391-4f7b0d7c533f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f44752ec82c74a28aa4dac2a2f8f88d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T03:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T03:58:47Z,use_quota=True,user_id='18d81f586d0a4e8ea083ba207b9f905e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:47.335205 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21087b9c-4eee-4a5c-8a27-3598c7867177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:47.339568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21087b9c-4eee-4a5c-8a27-3598c7867177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:47.343495 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8ae4fe-18a6-4474-beb3-c5c0ed9b9f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:47.360404 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8ae4fe-18a6-4474-beb3-c5c0ed9b9f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41b9c83-4795-4424-b391-4f7b0d7c533f', 'volume_name': 'volume-c41b9c83-4795-4424-b391-4f7b0d7c533f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:47.364879 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b2c0d4-33c3-47cd-abc8-a78ee71f39af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:47.367094 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b2c0d4-33c3-47cd-abc8-a78ee71f39af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:47.369245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8230bb-9c6d-4f33-aad6-578a2a5caff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:47.370029 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Volume c41b9c83-4795-4424-b391-4f7b0d7c533f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41b9c83-4795-4424-b391-4f7b0d7c533f', 'volume_size': 1} Nov 10 03:58:47.370991 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] creating volume 'volume-c41b9c83-4795-4424-b391-4f7b0d7c533f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 03:58:47.380059 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:58:47.496455 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 03:58:47.497076 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 03:58:47.500304 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8230bb-9c6d-4f33-aad6-578a2a5caff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41b9c83-4795-4424-b391-4f7b0d7c533f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:47.503740 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a19d45a-158b-4d97-ae5e-fac71ab0f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 03:58:47.516602 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-c41b9c83-4795-4424-b391-4f7b0d7c533f (c41b9c83-4795-4424-b391-4f7b0d7c533f): created successfully Nov 10 03:58:47.519708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a19d45a-158b-4d97-ae5e-fac71ab0f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 03:58:47.524041 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Flow 'volume_create_manager' (6cc1ef1c-eefd-4d02-8356-d1db37a0b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 03:58:47.535340 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-59e1aab6-ba79-4138-aa37-ce654249d13b tempest-TaggedBootDevicesTest-2048337972 None] Created volume successfully. Nov 10 03:59:09.154787 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-856a0479-cf06-420f-b374-84f9ae553a63 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:59:10.375487 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-856a0479-cf06-420f-b374-84f9ae553a63 tempest-TaggedBootDevicesTest-2048337972 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.219s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:59:10.377076 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-856a0479-cf06-420f-b374-84f9ae553a63 tempest-TaggedBootDevicesTest-2048337972 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d9503646-2c1b-46f1-9bbe-418ef20ac849', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'd9503646-2c1b-46f1-9bbe-418ef20ac849', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 03:59:10.498212 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-856a0479-cf06-420f-b374-84f9ae553a63 tempest-TaggedBootDevicesTest-2048337972 None] Connection info returned from driver {'name': 'volumes/volume-d9503646-2c1b-46f1-9bbe-418ef20ac849', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd9503646-2c1b-46f1-9bbe-418ef20ac849', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6aee0489-c1fe-4a04-9853-f33db8c76b54'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 03:59:10.623329 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-856a0479-cf06-420f-b374-84f9ae553a63 tempest-TaggedBootDevicesTest-2048337972 None] attachment_update completed successfully. Nov 10 03:59:11.131916 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-2b8575e7-c0fb-4fdc-bfaa-7434ad532b90 tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:59:12.278390 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-2b8575e7-c0fb-4fdc-bfaa-7434ad532b90 tempest-TaggedBootDevicesTest-2048337972 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.146s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:59:12.279256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-2b8575e7-c0fb-4fdc-bfaa-7434ad532b90 tempest-TaggedBootDevicesTest-2048337972 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 03:59:12.328917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-2b8575e7-c0fb-4fdc-bfaa-7434ad532b90 tempest-TaggedBootDevicesTest-2048337972 None] Connection info returned from driver {'name': 'volumes/volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9a0d099e-a73e-44e8-8262-6ad489bf17e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '71039112-ad5f-4084-a756-2cad63009234'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 03:59:12.421675 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-2b8575e7-c0fb-4fdc-bfaa-7434ad532b90 tempest-TaggedBootDevicesTest-2048337972 None] attachment_update completed successfully. Nov 10 03:59:12.941885 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-25f07ceb-e9af-434f-a99c-57001461431c tempest-TaggedBootDevicesTest-2048337972 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 03:59:13.835809 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-25f07ceb-e9af-434f-a99c-57001461431c tempest-TaggedBootDevicesTest-2048337972 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 03:59:13.836583 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-25f07ceb-e9af-434f-a99c-57001461431c tempest-TaggedBootDevicesTest-2048337972 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c41b9c83-4795-4424-b391-4f7b0d7c533f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'c41b9c83-4795-4424-b391-4f7b0d7c533f', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 03:59:13.862936 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-25f07ceb-e9af-434f-a99c-57001461431c tempest-TaggedBootDevicesTest-2048337972 None] Connection info returned from driver {'name': 'volumes/volume-c41b9c83-4795-4424-b391-4f7b0d7c533f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c41b9c83-4795-4424-b391-4f7b0d7c533f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7c722539-710c-4be9-ac8c-ff5ed01d3a72'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 03:59:13.933500 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-cc33d708-b2b5-4c55-9c93-45af44bb7c5a req-25f07ceb-e9af-434f-a99c-57001461431c tempest-TaggedBootDevicesTest-2048337972 None] attachment_update completed successfully. Nov 10 03:59:28.545170 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 03:59:28.546272 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:59:28.640446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 03:59:28.709610 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:00:15.698090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:00:15.704500 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:00:15.705145 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:00:15.718889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Flow 'volume_create_manager' (b7dc28de-c7e7-470e-9335-e8831f3412db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:00:15.722600 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63fdde1-ddbc-4aea-a031-a8b7d77ce566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:15.730699 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:00:15.745694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63fdde1-ddbc-4aea-a031-a8b7d77ce566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1807837015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=dda8f5aa-8b33-4d97-96f4-49ccad3d4fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea64fdb2282844728c33886df39a303b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:00:16Z,use_quota=True,user_id='2e9fa45517c0412c82e0f85634858963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:15.748628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b411820-1a4c-453f-8ab4-5b36aaf74f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:15.751562 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b411820-1a4c-453f-8ab4-5b36aaf74f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:15.754050 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252ebbcc-7b1f-4494-9a64-7293d7c6213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:15.756424 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252ebbcc-7b1f-4494-9a64-7293d7c6213a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'volume_name': 'volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:15.759245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871f40da-a118-4217-abd7-b34656df0409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:15.761593 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871f40da-a118-4217-abd7-b34656df0409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:15.765033 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1bc639-31a1-41bd-bddb-c8404a5760a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:15.765835 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Volume dda8f5aa-8b33-4d97-96f4-49ccad3d4fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'volume_size': 1} Nov 10 04:00:15.766881 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] creating volume 'volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:00:15.767877 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:00:15.837200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:00:15.837585 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:00:15.839819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1bc639-31a1-41bd-bddb-c8404a5760a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:15.841981 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6ee253-a9b9-49e9-a232-6595a4f2c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:15.851465 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Volume volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce (dda8f5aa-8b33-4d97-96f4-49ccad3d4fce): created successfully Nov 10 04:00:15.854463 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6ee253-a9b9-49e9-a232-6595a4f2c66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:15.857882 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Flow 'volume_create_manager' (b7dc28de-c7e7-470e-9335-e8831f3412db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:00:15.871395 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0a63e21d-510c-461c-aa38-c030d3f09569 tempest-LiveMigrationTest-2107580141 None] Created volume successfully. Nov 10 04:00:17.507080 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-4bf31e3d-e69d-4de3-8a78-dbbadced0374 req-85e01819-8c75-4a8d-8aca-123ccdc6a486 tempest-LiveMigrationTest-2107580141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:00:18.233034 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-4bf31e3d-e69d-4de3-8a78-dbbadced0374 req-85e01819-8c75-4a8d-8aca-123ccdc6a486 tempest-LiveMigrationTest-2107580141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.726s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:00:18.234304 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-4bf31e3d-e69d-4de3-8a78-dbbadced0374 req-85e01819-8c75-4a8d-8aca-123ccdc6a486 tempest-LiveMigrationTest-2107580141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:00:18.267765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-4bf31e3d-e69d-4de3-8a78-dbbadced0374 req-85e01819-8c75-4a8d-8aca-123ccdc6a486 tempest-LiveMigrationTest-2107580141 None] Connection info returned from driver {'name': 'volumes/volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '12373a60-e414-41ef-9f4c-a8f1acea3c04'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:00:18.372408 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-4bf31e3d-e69d-4de3-8a78-dbbadced0374 req-85e01819-8c75-4a8d-8aca-123ccdc6a486 tempest-LiveMigrationTest-2107580141 None] attachment_update completed successfully. Nov 10 04:00:26.145552 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-47bfa35b-3da2-42ab-bc31-9a90871ae01d tempest-LiveMigrationTest-884092821 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:00:26.980923 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-47bfa35b-3da2-42ab-bc31-9a90871ae01d tempest-LiveMigrationTest-884092821 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.835s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:00:26.981969 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-47bfa35b-3da2-42ab-bc31-9a90871ae01d tempest-LiveMigrationTest-884092821 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:00:27.005954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-47bfa35b-3da2-42ab-bc31-9a90871ae01d tempest-LiveMigrationTest-884092821 None] Connection info returned from driver {'name': 'volumes/volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dda8f5aa-8b33-4d97-96f4-49ccad3d4fce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2521a713-51fe-4cd5-a82d-82d11b3a045c'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:00:27.061912 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-47bfa35b-3da2-42ab-bc31-9a90871ae01d tempest-LiveMigrationTest-884092821 None] attachment_update completed successfully. Nov 10 04:00:38.755313 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-1aa0452d-d9c9-465a-960a-290ac1736640 tempest-LiveMigrationTest-884092821 None] Terminate volume connection completed successfully. Nov 10 04:00:38.755899 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-1f506b82-e96a-4bd8-ae18-71da07dd991a req-1aa0452d-d9c9-465a-960a-290ac1736640 tempest-LiveMigrationTest-884092821 None] Deleting attachment 12373a60-e414-41ef-9f4c-a8f1acea3c04. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:00:46.462484 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-449157b6-49f3-4799-88c8-180b6ebb574c req-aee4e276-47af-4edf-8ba1-07cf0000f74a tempest-LiveMigrationTest-2107580141 None] Terminate volume connection completed successfully. Nov 10 04:00:46.463154 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-449157b6-49f3-4799-88c8-180b6ebb574c req-aee4e276-47af-4edf-8ba1-07cf0000f74a tempest-LiveMigrationTest-2107580141 None] Deleting attachment 2521a713-51fe-4cd5-a82d-82d11b3a045c. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:00:48.566942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:00:48.572143 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:00:48.572774 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:00:48.587339 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Flow 'volume_create_manager' (85b18447-db54-4a82-a28d-c932bcde5bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:00:48.590681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5c482e-47b4-4ded-a484-68b5c14a6f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:48.605134 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:00:48.623777 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5c482e-47b4-4ded-a484-68b5c14a6f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1346443781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=39b3ac43-f5f9-472f-853c-cb3063455c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea64fdb2282844728c33886df39a303b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:00:49Z,use_quota=True,user_id='2e9fa45517c0412c82e0f85634858963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:48.627363 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29f55c9-a977-44f2-9b83-5a92aefe2bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:48.631145 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29f55c9-a977-44f2-9b83-5a92aefe2bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:48.634389 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c6e877-bd04-4740-b405-32f52c7c2ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:48.791568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c6e877-bd04-4740-b405-32f52c7c2ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39b3ac43-f5f9-472f-853c-cb3063455c0b', 'volume_name': 'volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:48.795141 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81393710-736d-4808-a52a-21b1c0ef1cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:48.797751 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81393710-736d-4808-a52a-21b1c0ef1cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:48.800686 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46ed9ed-d168-4d7a-91de-070d3fa04775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:48.801746 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Volume 39b3ac43-f5f9-472f-853c-cb3063455c0b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:00:48.802730 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Cloning 39b3ac43-f5f9-472f-853c-cb3063455c0b from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:00:48.839503 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.035s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:00:48.858508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 0, 48, 845072)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:00:48.859237 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:00:48.859907 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:00:48.865919 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:00:48.866985 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:00:48.874472 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 0, 48, 870677)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:00:48.875457 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:00:48.876709 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:00:48.902064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:00:49.011980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] creating snapshot='volume-39b3ac43-f5f9-472f-853c-cb3063455c0b.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:00:49.322716 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-39b3ac43-f5f9-472f-853c-cb3063455c0b.clone_snap' to 'volume-39b3ac43-f5f9-472f-853c-cb3063455c0b' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:00:49.562870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:00:49.564108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:00:49.564747 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:00:49.595042 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:00:49.596581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Marking volume 39b3ac43-f5f9-472f-853c-cb3063455c0b as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:00:49.610197 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 39b3ac43-f5f9-472f-853c-cb3063455c0b. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:00:49.611606 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Creating volume glance metadata for volume 39b3ac43-f5f9-472f-853c-cb3063455c0b backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:00:49.681161 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46ed9ed-d168-4d7a-91de-070d3fa04775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:49.685207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641d2809-e571-4f52-80c4-38a3fe774a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:00:49.702531 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Volume volume-39b3ac43-f5f9-472f-853c-cb3063455c0b (39b3ac43-f5f9-472f-853c-cb3063455c0b): created successfully Nov 10 04:00:49.707497 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641d2809-e571-4f52-80c4-38a3fe774a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:00:49.717165 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Flow 'volume_create_manager' (85b18447-db54-4a82-a28d-c932bcde5bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:00:49.728951 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8fbc2440-c268-47e6-accd-bc2a1bf111ca tempest-LiveMigrationTest-2107580141 None] Created volume successfully. Nov 10 04:00:54.796044 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-f600e8a7-638b-41f8-9bd7-7e42ecf81168 req-8e298413-315b-4fb0-828b-f0d41ee3ab25 tempest-LiveMigrationTest-2107580141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:00:55.687991 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-f600e8a7-638b-41f8-9bd7-7e42ecf81168 req-8e298413-315b-4fb0-828b-f0d41ee3ab25 tempest-LiveMigrationTest-2107580141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.892s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:00:55.688893 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-f600e8a7-638b-41f8-9bd7-7e42ecf81168 req-8e298413-315b-4fb0-828b-f0d41ee3ab25 tempest-LiveMigrationTest-2107580141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '39b3ac43-f5f9-472f-853c-cb3063455c0b', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:00:55.745373 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-f600e8a7-638b-41f8-9bd7-7e42ecf81168 req-8e298413-315b-4fb0-828b-f0d41ee3ab25 tempest-LiveMigrationTest-2107580141 None] Connection info returned from driver {'name': 'volumes/volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39b3ac43-f5f9-472f-853c-cb3063455c0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '47278ebc-80ec-44b4-a340-ffc22141c67d'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:00:55.867401 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-f600e8a7-638b-41f8-9bd7-7e42ecf81168 req-8e298413-315b-4fb0-828b-f0d41ee3ab25 tempest-LiveMigrationTest-2107580141 None] attachment_update completed successfully. Nov 10 04:01:10.553197 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-021c9368-e91c-4d4e-987a-a80839d39cf4 tempest-BackendsCapabilitiesAdminTestsJSON-1483731722 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:9b83638b-82ec-4601-b6df-16c5dc5750ec:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=127842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4729}} Nov 10 04:01:10.635747 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab44595a-4e79-4e35-a4c9-d8ffca831e2c tempest-BackendsCapabilitiesAdminTestsJSON-1483731722 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:9b83638b-82ec-4601-b6df-16c5dc5750ec:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=127842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4729}} Nov 10 04:01:16.844018 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ea5dd47c-e413-4a26-91a5-4c733f29cc29 tempest-GroupsV320Test-1427426954 None] Group tempest-GroupsV320Test-Group-1873429355: creating Nov 10 04:01:16.883142 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ea5dd47c-e413-4a26-91a5-4c733f29cc29 tempest-GroupsV320Test-1427426954 None] Group tempest-GroupsV320Test-Group-1873429355: created successfully Nov 10 04:01:16.901496 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ea5dd47c-e413-4a26-91a5-4c733f29cc29 tempest-GroupsV320Test-1427426954 None] Create group completed successfully. Nov 10 04:01:18.766772 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-a12db87c-ec32-4eb2-b7db-faae5b74d3ba tempest-GroupsV320Test-1427426954 None] Created reservations ['99cb6371-d7a7-4230-931b-bae7a4b7898d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:01:18.828775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a12db87c-ec32-4eb2-b7db-faae5b74d3ba tempest-GroupsV320Test-1427426954 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:18.886838 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a12db87c-ec32-4eb2-b7db-faae5b74d3ba tempest-GroupsV320Test-1427426954 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:18.924735 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-a12db87c-ec32-4eb2-b7db-faae5b74d3ba tempest-GroupsV320Test-1427426954 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:01:18.931518 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a12db87c-ec32-4eb2-b7db-faae5b74d3ba tempest-GroupsV320Test-1427426954 None] Delete group completed successfully. Nov 10 04:01:25.846641 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-4cca2fbf-0563-4c6e-a850-d83dda33e33f tempest-LiveMigrationTest-884092821 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:01:27.009149 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-4cca2fbf-0563-4c6e-a850-d83dda33e33f tempest-LiveMigrationTest-884092821 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.164s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:01:27.010765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-4cca2fbf-0563-4c6e-a850-d83dda33e33f tempest-LiveMigrationTest-884092821 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '39b3ac43-f5f9-472f-853c-cb3063455c0b', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:01:27.050466 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-4cca2fbf-0563-4c6e-a850-d83dda33e33f tempest-LiveMigrationTest-884092821 None] Connection info returned from driver {'name': 'volumes/volume-39b3ac43-f5f9-472f-853c-cb3063455c0b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39b3ac43-f5f9-472f-853c-cb3063455c0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7527938a-f72a-41d7-bdfe-490ec586efc4'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:01:27.145508 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-4cca2fbf-0563-4c6e-a850-d83dda33e33f tempest-LiveMigrationTest-884092821 None] attachment_update completed successfully. Nov 10 04:01:28.547334 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:01:28.549221 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:28.615458 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:28.677776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:01:34.947390 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-6f725718-4054-4c02-a1e7-651a38d05444 tempest-LiveMigrationTest-884092821 None] Terminate volume connection completed successfully. Nov 10 04:01:34.947988 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bdb197a1-f007-47f2-8805-2fc2b5f98220 req-6f725718-4054-4c02-a1e7-651a38d05444 tempest-LiveMigrationTest-884092821 None] Deleting attachment 47278ebc-80ec-44b4-a340-ffc22141c67d. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:01:43.626749 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-7e2a8554-788d-4fb7-8f68-42ec6571695e tempest-LiveMigrationTest-2107580141 None] Terminate volume connection completed successfully. Nov 10 04:01:43.627467 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-7e2a8554-788d-4fb7-8f68-42ec6571695e tempest-LiveMigrationTest-2107580141 None] Deleting attachment 7527938a-f72a-41d7-bdfe-490ec586efc4. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:01:43.912218 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] Lock "b'cinder-39b3ac43-f5f9-472f-853c-cb3063455c0b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:01:43.965074 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:44.113531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:01:44.129162 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] deleting rbd volume volume-39b3ac43-f5f9-472f-853c-cb3063455c0b {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:01:44.674260 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:01:44.733760 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] deleting parent snapshot volume-39b3ac43-f5f9-472f-853c-cb3063455c0b.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:01:45.404855 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] Created reservations ['1d05cfe5-b574-41ad-a5fe-f6a170fea3e1', '3fd1615c-6f77-41e4-96ac-d6722a20fe72', 'c3a92194-cdd8-47dd-8f52-53cd4ba312e2', '6570f884-9720-471b-a82f-4cca66cf069d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:01:45.492756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:45.591084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:45.681705 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:01:45.690197 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] Deleted volume successfully. Nov 10 04:01:45.712930 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-21c8c675-f2c4-4100-a23f-50d4a7a32b93 req-3d844f73-a034-4df2-bd40-a648e3fd2caa tempest-LiveMigrationTest-2107580141 None] Lock "b'cinder-39b3ac43-f5f9-472f-853c-cb3063455c0b-delete_volume'" released by "delete_volume" :: held 1.801s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:01:45.861983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] Lock "b'cinder-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:01:45.917527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:46.055129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:01:46.055989 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] Volume volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:01:46.072075 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] deleting rbd volume volume-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:01:46.647831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] Created reservations ['5f574871-a9fb-4b2a-a4dc-ea00148223a8', '3c278aa0-fa25-44e6-8ffe-9b10f26b5482', 'b00383f2-4865-4a48-a9c3-fd59cc23ad5a', '4238daf5-4910-4454-a912-96f599129bf5'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:01:46.713422 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:46.792627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:46.862395 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:01:46.869861 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] Deleted volume successfully. Nov 10 04:01:46.890527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7b932abb-87f9-4dcf-b83d-d3bee77d0069 tempest-LiveMigrationTest-2107580141 None] Lock "b'cinder-dda8f5aa-8b33-4d97-96f4-49ccad3d4fce-delete_volume'" released by "delete_volume" :: held 1.031s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:01:54.048511 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:01:54.057597 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:01:54.058546 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:01:54.089454 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Flow 'volume_create_manager' (7e429719-a6df-4fb9-ab6d-154041aa6e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:01:54.093368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ba9a20-cc98-40bb-b9e9-4769484e8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:54.100743 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:01:54.116813 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ba9a20-cc98-40bb-b9e9-4769484e8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-5991462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=e231f4bd-27ef-4178-978a-9708887598df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc5d858ae694d3480a3caa09d836cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:01:54Z,use_quota=True,user_id='d17fccaa5fc5428e9434a791f5860555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:54.119777 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe12f24-eb89-41fc-8143-f9ce23e3069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:54.122040 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe12f24-eb89-41fc-8143-f9ce23e3069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:54.124663 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339f7ee1-e526-4854-8427-a21c5447a2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:54.130310 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339f7ee1-e526-4854-8427-a21c5447a2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e231f4bd-27ef-4178-978a-9708887598df', 'volume_name': 'volume-e231f4bd-27ef-4178-978a-9708887598df', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:54.134310 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517d2f7d-b101-41f6-8d71-1bf84b929fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:54.154108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517d2f7d-b101-41f6-8d71-1bf84b929fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:54.158797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c82abf-79ed-4b36-83c5-5bdd202af896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:54.164324 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Volume e231f4bd-27ef-4178-978a-9708887598df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e231f4bd-27ef-4178-978a-9708887598df', 'volume_size': 1} Nov 10 04:01:54.165012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] creating volume 'volume-e231f4bd-27ef-4178-978a-9708887598df' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:01:54.166135 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:54.253835 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:01:54.254460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:01:54.257099 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c82abf-79ed-4b36-83c5-5bdd202af896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e231f4bd-27ef-4178-978a-9708887598df', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:54.259346 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a737f5-34e6-4eaa-a9a6-c878957d1863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:54.269666 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Volume volume-e231f4bd-27ef-4178-978a-9708887598df (e231f4bd-27ef-4178-978a-9708887598df): created successfully Nov 10 04:01:54.283637 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a737f5-34e6-4eaa-a9a6-c878957d1863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:54.288229 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Flow 'volume_create_manager' (7e429719-a6df-4fb9-ab6d-154041aa6e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:01:54.299178 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6e11c30e-f350-4507-9254-61853544e7e3 tempest-VolumesTransfersTest-1059166242 None] Created volume successfully. Nov 10 04:01:56.166572 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5d9cbff5-d762-466b-80b9-977972471822 tempest-VolumesTransfersTest-674690406 None] Transfer volume completed successfully. Nov 10 04:01:56.992223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] Lock "b'cinder-e231f4bd-27ef-4178-978a-9708887598df-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:01:57.122558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:57.242544 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:01:57.243156 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] Volume volume-e231f4bd-27ef-4178-978a-9708887598df is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:01:57.260174 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] deleting rbd volume volume-e231f4bd-27ef-4178-978a-9708887598df {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:01:57.814611 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] Created reservations ['85e78b1f-6165-41d5-b6c7-5008dc46925b', '6bf9361e-31d5-4cc6-975d-b2deaab120bd', '07530693-8f51-40f0-81cd-7d2402a955a0', '91860863-4d39-402d-a1ff-469aa518c134'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:01:57.958726 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:58.135355 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:58.237227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:01:58.245508 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] Deleted volume successfully. Nov 10 04:01:58.263042 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9ab15719-1508-4fcf-b121-6886912b7c55 tempest-VolumesTransfersTest-825675908 None] Lock "b'cinder-e231f4bd-27ef-4178-978a-9708887598df-delete_volume'" released by "delete_volume" :: held 1.272s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:01:58.963847 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:01:58.967151 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:01:58.967604 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:01:59.012977 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Flow 'volume_create_manager' (43002d35-d89e-4402-8514-0afef6311aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:01:59.022144 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8335b5b-8dca-4843-b352-2ceebb0b0158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:59.042049 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:01:59.055540 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8335b5b-8dca-4843-b352-2ceebb0b0158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1725929024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b1f9693d-23ae-4d65-9a61-055107f2afaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bc5d858ae694d3480a3caa09d836cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:01:59Z,use_quota=True,user_id='d17fccaa5fc5428e9434a791f5860555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:59.070121 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa8e52f-4d8e-4f5c-8a75-05492574e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:59.074296 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa8e52f-4d8e-4f5c-8a75-05492574e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:59.077727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a3ca8e-814c-4884-a993-ce5c064d3086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:59.088226 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a3ca8e-814c-4884-a993-ce5c064d3086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f9693d-23ae-4d65-9a61-055107f2afaf', 'volume_name': 'volume-b1f9693d-23ae-4d65-9a61-055107f2afaf', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:59.093951 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c92b6ee-ea96-4af7-82f1-9629b04a52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:59.096504 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c92b6ee-ea96-4af7-82f1-9629b04a52dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:59.103649 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a0fbf2-17f5-4f96-8a31-40663cccaf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:59.107860 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Volume b1f9693d-23ae-4d65-9a61-055107f2afaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f9693d-23ae-4d65-9a61-055107f2afaf', 'volume_size': 1} Nov 10 04:01:59.111129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] creating volume 'volume-b1f9693d-23ae-4d65-9a61-055107f2afaf' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:01:59.112825 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:01:59.261268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:01:59.262442 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:01:59.264582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a0fbf2-17f5-4f96-8a31-40663cccaf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f9693d-23ae-4d65-9a61-055107f2afaf', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:59.267422 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3859c62-18fa-49e7-bb60-0be061124466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:01:59.287020 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Volume volume-b1f9693d-23ae-4d65-9a61-055107f2afaf (b1f9693d-23ae-4d65-9a61-055107f2afaf): created successfully Nov 10 04:01:59.289814 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3859c62-18fa-49e7-bb60-0be061124466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:01:59.293042 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Flow 'volume_create_manager' (43002d35-d89e-4402-8514-0afef6311aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:01:59.308159 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b27f9e41-1052-4014-b8dd-be9d3e9d9534 tempest-VolumesTransfersTest-1059166242 None] Created volume successfully. Nov 10 04:02:00.424135 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] Lock "b'cinder-b1f9693d-23ae-4d65-9a61-055107f2afaf-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:02:00.480264 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:00.565854 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:02:00.566552 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] Volume volume-b1f9693d-23ae-4d65-9a61-055107f2afaf is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:02:00.574268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] deleting rbd volume volume-b1f9693d-23ae-4d65-9a61-055107f2afaf {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:02:01.190546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] Created reservations ['2cbe0a37-1647-4f63-bfa1-6bc648c0e62f', 'c0724a2e-f4e0-4a06-8230-f75f9ea792d5', '4bcb1d26-c304-4999-962b-b750f521da7a', 'cce5e875-0002-47ca-8c5d-ccf9523d72bc'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:02:01.294274 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:01.377341 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:01.443368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:02:01.450539 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] Deleted volume successfully. Nov 10 04:02:01.475469 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b1af5743-9875-43bc-b587-c2f2c8d1db1a tempest-VolumesTransfersTest-825675908 None] Lock "b'cinder-b1f9693d-23ae-4d65-9a61-055107f2afaf-delete_volume'" released by "delete_volume" :: held 1.052s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:02:10.464256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:02:10.475987 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:02:10.476449 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:02:10.536351 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Flow 'volume_create_manager' (01dd4b23-3537-4b6f-92a7-69db82a42b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:02:10.541398 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ceea618-9aec-4e29-9fc6-f27c7052f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:10.551915 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:02:10.588525 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ceea618-9aec-4e29-9fc6-f27c7052f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1143345583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=63b1f85d-1092-4752-8fcd-50639483d60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c38a86cf147b4975c1a6e3cd149ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:02:10Z,use_quota=True,user_id='f4d2b7c3dfeb4772b7cad1bf63c9d193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:10.593035 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14324852-c691-47fa-928d-b7a710deb382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:10.595495 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14324852-c691-47fa-928d-b7a710deb382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:10.610923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ede7f6-9426-4e79-a715-2037c28573e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:10.762167 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ede7f6-9426-4e79-a715-2037c28573e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63b1f85d-1092-4752-8fcd-50639483d60f', 'volume_name': 'volume-63b1f85d-1092-4752-8fcd-50639483d60f', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:10.764797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28cfdb6-7a38-42a2-91c7-10b7cd310e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:10.767408 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28cfdb6-7a38-42a2-91c7-10b7cd310e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:10.775985 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fba00-2cc0-426d-8d8c-825980f85361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:10.777453 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Volume 63b1f85d-1092-4752-8fcd-50639483d60f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63b1f85d-1092-4752-8fcd-50639483d60f', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:02:10.778169 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Cloning 63b1f85d-1092-4752-8fcd-50639483d60f from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:02:10.792859 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:02:10.818780 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 2, 10, 803704)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:02:10.819551 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:02:10.820493 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:02:10.825881 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:02:10.827128 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:02:10.843781 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 2, 10, 837673)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:02:10.844666 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:02:10.845308 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:02:10.866091 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:10.981230 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] creating snapshot='volume-63b1f85d-1092-4752-8fcd-50639483d60f.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:02:11.174996 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-63b1f85d-1092-4752-8fcd-50639483d60f.clone_snap' to 'volume-63b1f85d-1092-4752-8fcd-50639483d60f' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:02:11.433343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:02:11.435150 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:02:11.435763 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:02:11.480295 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:02:11.481344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Marking volume 63b1f85d-1092-4752-8fcd-50639483d60f as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:02:11.502126 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 63b1f85d-1092-4752-8fcd-50639483d60f. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:02:11.503553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Creating volume glance metadata for volume 63b1f85d-1092-4752-8fcd-50639483d60f backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:02:11.764768 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fba00-2cc0-426d-8d8c-825980f85361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b1f85d-1092-4752-8fcd-50639483d60f', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:11.770951 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d3254a-9e8b-4ff8-a99b-c858b7c5369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:11.801467 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Volume volume-63b1f85d-1092-4752-8fcd-50639483d60f (63b1f85d-1092-4752-8fcd-50639483d60f): created successfully Nov 10 04:02:11.806325 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d3254a-9e8b-4ff8-a99b-c858b7c5369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:11.812439 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Flow 'volume_create_manager' (01dd4b23-3537-4b6f-92a7-69db82a42b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:02:11.828337 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-678bbbf7-6e8c-43dc-b249-40712da1d96f tempest-VolumesExtendTest-556130000 None] Created volume successfully. Nov 10 04:02:12.908918 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6cf9dcf7-87f1-4fce-88e2-1a84add41aed tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:13.215151 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6cf9dcf7-87f1-4fce-88e2-1a84add41aed tempest-VolumesExtendTest-556130000 None] Extend volume from 1 GB to 2 GB. {{(pid=127842) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1731}} Nov 10 04:02:13.270362 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6cf9dcf7-87f1-4fce-88e2-1a84add41aed tempest-VolumesExtendTest-556130000 None] Extend volume completed successfully. Nov 10 04:02:14.875172 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:02:14.878835 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:02:14.879959 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:02:14.919907 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Flow 'volume_create_manager' (be8d63a2-1cf4-4b3a-911a-87c9c0bacf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:02:14.921007 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd17bbe-1193-4380-8848-052b554b55a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:14.930413 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:02:14.964700 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd17bbe-1193-4380-8848-052b554b55a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-815782758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=82525ad0-8aa1-4e3f-8507-02d0c9fc9295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277c38a86cf147b4975c1a6e3cd149ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:02:15Z,use_quota=True,user_id='f4d2b7c3dfeb4772b7cad1bf63c9d193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:14.967561 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a33b671-2808-4263-9298-10c072020f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:14.970819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a33b671-2808-4263-9298-10c072020f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:14.974121 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c824e60a-880d-42e6-b778-344753e25e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:14.976915 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c824e60a-880d-42e6-b778-344753e25e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82525ad0-8aa1-4e3f-8507-02d0c9fc9295', 'volume_name': 'volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:14.983025 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5934e374-2bc8-4b8f-b234-220720593d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:14.985505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5934e374-2bc8-4b8f-b234-220720593d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:14.987800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a27f08-c167-4cb3-a5d4-2e44efb81c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:14.989341 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Volume 82525ad0-8aa1-4e3f-8507-02d0c9fc9295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295', 'volume_size': 1} Nov 10 04:02:14.990016 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] creating volume 'volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:02:14.991613 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:15.089224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:02:15.089657 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:02:15.094805 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a27f08-c167-4cb3-a5d4-2e44efb81c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:15.099556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78dc2ed-bf47-41a8-974b-efc44f66dad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:02:15.122978 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Volume volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295 (82525ad0-8aa1-4e3f-8507-02d0c9fc9295): created successfully Nov 10 04:02:15.126538 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78dc2ed-bf47-41a8-974b-efc44f66dad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:02:15.134681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Flow 'volume_create_manager' (be8d63a2-1cf4-4b3a-911a-87c9c0bacf6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:02:15.160838 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7f2df01c-0efa-4932-bc1c-12722bbd972e tempest-VolumesExtendTest-556130000 None] Created volume successfully. Nov 10 04:02:16.454695 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5536257d-0b05-4eeb-9fde-efa0f388d37e tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:17.497592 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5536257d-0b05-4eeb-9fde-efa0f388d37e tempest-VolumesExtendTest-556130000 None] Create snapshot completed successfully Nov 10 04:02:18.940260 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8d2acd83-9661-4ec6-9b7f-3549fc723e12 tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:19.147925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8d2acd83-9661-4ec6-9b7f-3549fc723e12 tempest-VolumesExtendTest-556130000 None] Extend volume from 1 GB to 2 GB. {{(pid=127842) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1731}} Nov 10 04:02:19.189274 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8d2acd83-9661-4ec6-9b7f-3549fc723e12 tempest-VolumesExtendTest-556130000 None] Extend volume completed successfully. Nov 10 04:02:20.452452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-84ed8814-4a36-4164-8bd8-89954bcacdb0 tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-301241c6-d9b4-44f3-8e83-2730e7836649-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:02:20.459046 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-84ed8814-4a36-4164-8bd8-89954bcacdb0 tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:21.259399 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-84ed8814-4a36-4164-8bd8-89954bcacdb0 tempest-VolumesExtendTest-556130000 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:02:21.289460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-84ed8814-4a36-4164-8bd8-89954bcacdb0 tempest-VolumesExtendTest-556130000 None] Created reservations ['be6f83ca-0a3a-473b-aeef-f9b186e954b9', '89c2f997-b304-40ad-a8fc-6d8dedaa6ab0', 'f15afd3d-a4bd-42ee-92f9-f418dbf3455a', '4b7cd9db-45f1-4c02-9ad6-c7f3cc446a85'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:02:21.367475 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-84ed8814-4a36-4164-8bd8-89954bcacdb0 tempest-VolumesExtendTest-556130000 None] Delete snapshot completed successfully. Nov 10 04:02:21.385384 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-84ed8814-4a36-4164-8bd8-89954bcacdb0 tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-301241c6-d9b4-44f3-8e83-2730e7836649-delete_snapshot'" released by "delete_snapshot" :: held 0.936s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:02:21.674010 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-82525ad0-8aa1-4e3f-8507-02d0c9fc9295-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:02:21.793680 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:21.933246 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:02:21.933605 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] Volume volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:02:21.948440 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] deleting rbd volume volume-82525ad0-8aa1-4e3f-8507-02d0c9fc9295 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:02:22.467533 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] Created reservations ['b87fe177-0d5a-4218-bcfd-1587389a6ef4', '9eea4a7d-2fb1-4d46-8b07-473fb7a186c4', '49eb2fe0-2250-46ec-8594-f2277a52b1a5', '2268f9b8-618c-4c0f-8ab5-cc9c8c0187d3'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:02:22.563740 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:22.636051 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:22.702992 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:02:22.709031 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] Deleted volume successfully. Nov 10 04:02:22.751202 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5f5f6a23-7c79-428a-98c4-8e44364234ea tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-82525ad0-8aa1-4e3f-8507-02d0c9fc9295-delete_volume'" released by "delete_volume" :: held 1.070s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:02:22.927887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-63b1f85d-1092-4752-8fcd-50639483d60f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:02:22.991451 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:23.108405 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:02:23.118792 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] deleting rbd volume volume-63b1f85d-1092-4752-8fcd-50639483d60f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:02:23.574954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:02:23.627743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] deleting parent snapshot volume-63b1f85d-1092-4752-8fcd-50639483d60f.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:02:24.397367 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] Created reservations ['440703d8-5aab-4c3c-8c35-2cc09eab22b0', '3c3d8bfa-836d-44f8-b6e7-93f31a557dd2', '5f566592-3df1-40ab-9524-269dde1cfc61', 'c59e22d5-b779-4b2b-8096-05cc97ccd59d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:02:24.495498 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:24.600056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:24.675101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:02:24.682833 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] Deleted volume successfully. Nov 10 04:02:24.707865 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-29b38325-7d22-4550-9250-c78171a1e292 tempest-VolumesExtendTest-556130000 None] Lock "b'cinder-63b1f85d-1092-4752-8fcd-50639483d60f-delete_volume'" released by "delete_volume" :: held 1.791s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:02:28.543367 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:02:28.544020 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:28.624110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:02:28.695978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:03:28.546077 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:03:28.546763 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:03:28.599114 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:03:28.647110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:03:40.782327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:03:40.788362 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:03:40.788899 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:03:40.801502 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Flow 'volume_create_manager' (b4fff308-6b9c-4b23-ae1e-89c190a272ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:03:40.805378 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd5d00f-83ee-427d-8c2b-44a4e5441e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:40.815050 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:03:40.829303 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd5d00f-83ee-427d-8c2b-44a4e5441e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-332442433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=c4fda05b-2142-46a3-bbce-e8f084f23384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444d571fcd742ef8ce43822b52d49be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:03:41Z,use_quota=True,user_id='43457152ab024c74b5bf1b83a69aa4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:40.831980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bab9f35-25f5-41c0-93f0-a8d8ab9b9741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:40.834261 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bab9f35-25f5-41c0-93f0-a8d8ab9b9741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:40.837217 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af0563c-d23f-4757-85ff-0583b15d2eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:40.947831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af0563c-d23f-4757-85ff-0583b15d2eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4fda05b-2142-46a3-bbce-e8f084f23384', 'volume_name': 'volume-c4fda05b-2142-46a3-bbce-e8f084f23384', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:40.950477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fdf930-ac3a-45b5-bc1b-a6e55a6f9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:40.953083 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fdf930-ac3a-45b5-bc1b-a6e55a6f9710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:40.956778 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be52a821-758a-4668-9e24-a76d3f43db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:40.957707 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume c4fda05b-2142-46a3-bbce-e8f084f23384: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4fda05b-2142-46a3-bbce-e8f084f23384', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:03:40.958284 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Cloning c4fda05b-2142-46a3-bbce-e8f084f23384 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:03:40.971889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:03:40.989454 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 3, 40, 982090)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:03:40.990291 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:03:40.991630 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:03:41.012316 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:03:41.013440 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:03:41.021177 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 3, 41, 17963)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:03:41.021981 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:03:41.022550 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:03:41.036071 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:03:41.163836 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] creating snapshot='volume-c4fda05b-2142-46a3-bbce-e8f084f23384.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:03:42.255678 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-c4fda05b-2142-46a3-bbce-e8f084f23384.clone_snap' to 'volume-c4fda05b-2142-46a3-bbce-e8f084f23384' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:03:42.413610 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:03:42.414800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:03:42.415516 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:03:42.439056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:03:42.440056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Marking volume c4fda05b-2142-46a3-bbce-e8f084f23384 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:03:42.453556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to c4fda05b-2142-46a3-bbce-e8f084f23384. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:03:42.454858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Creating volume glance metadata for volume c4fda05b-2142-46a3-bbce-e8f084f23384 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:03:42.533940 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be52a821-758a-4668-9e24-a76d3f43db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fda05b-2142-46a3-bbce-e8f084f23384', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:42.536982 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436e4aab-982c-454f-ad40-c9ecdfba9440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:42.549357 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume volume-c4fda05b-2142-46a3-bbce-e8f084f23384 (c4fda05b-2142-46a3-bbce-e8f084f23384): created successfully Nov 10 04:03:42.551765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436e4aab-982c-454f-ad40-c9ecdfba9440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:42.556857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Flow 'volume_create_manager' (b4fff308-6b9c-4b23-ae1e-89c190a272ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:03:42.578144 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-91068469-06fa-4af5-b019-38d1101f27fe tempest-TaggedBootDevicesTest_v242-2045997453 None] Created volume successfully. Nov 10 04:03:43.470333 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:03:43.492684 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:03:43.495468 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:03:43.517449 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Flow 'volume_create_manager' (d74e35ed-8e61-4ca2-8158-f5e20624e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:03:43.521890 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28ebfed-3fd1-4d65-9954-00a7ecd5aa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:43.531036 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:03:43.547066 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28ebfed-3fd1-4d65-9954-00a7ecd5aa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-529957789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=e4fbf22b-09b7-4560-9bef-63f164558bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444d571fcd742ef8ce43822b52d49be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:03:43Z,use_quota=True,user_id='43457152ab024c74b5bf1b83a69aa4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:43.550621 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55b8e26-0e14-4678-a69b-f2043ba3395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:43.553140 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55b8e26-0e14-4678-a69b-f2043ba3395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:43.555768 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd088b4b-9d66-46a0-8058-4120ea0bd478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:43.558371 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd088b4b-9d66-46a0-8058-4120ea0bd478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fbf22b-09b7-4560-9bef-63f164558bde', 'volume_name': 'volume-e4fbf22b-09b7-4560-9bef-63f164558bde', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:43.561244 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a99f0-d21b-4be7-b03f-354faf202347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:43.567306 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974a99f0-d21b-4be7-b03f-354faf202347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:43.570239 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365898d9-52f7-48b5-ab9a-64fc939a5df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:43.571284 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume e4fbf22b-09b7-4560-9bef-63f164558bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fbf22b-09b7-4560-9bef-63f164558bde', 'volume_size': 1} Nov 10 04:03:43.572137 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] creating volume 'volume-e4fbf22b-09b7-4560-9bef-63f164558bde' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:03:43.573439 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:03:43.708922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:03:43.709590 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:03:43.711749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365898d9-52f7-48b5-ab9a-64fc939a5df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fbf22b-09b7-4560-9bef-63f164558bde', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:43.714243 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afcbd3b-d0e9-433c-abfa-10ccb728ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:43.726122 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume volume-e4fbf22b-09b7-4560-9bef-63f164558bde (e4fbf22b-09b7-4560-9bef-63f164558bde): created successfully Nov 10 04:03:43.728676 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afcbd3b-d0e9-433c-abfa-10ccb728ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:43.732559 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Flow 'volume_create_manager' (d74e35ed-8e61-4ca2-8158-f5e20624e025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:03:43.743262 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f73f9159-f219-419a-a657-6bed9d676b71 tempest-TaggedBootDevicesTest_v242-2045997453 None] Created volume successfully. Nov 10 04:03:44.942856 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:03:44.949592 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:03:44.950117 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:03:44.968043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Flow 'volume_create_manager' (13efa434-6103-43bb-a1d4-93fbb8fbcd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:03:44.972803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd43e576-c5ce-42b9-ac1d-b7bed76d3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:44.981604 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:03:44.999624 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd43e576-c5ce-42b9-ac1d-b7bed76d3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1775852718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=023f9c05-65f5-44bd-b072-3c8d6c1feead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3444d571fcd742ef8ce43822b52d49be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:03:45Z,use_quota=True,user_id='43457152ab024c74b5bf1b83a69aa4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:45.002508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71734caa-af82-4a3a-8220-f4fcbf0b5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:45.004600 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71734caa-af82-4a3a-8220-f4fcbf0b5e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:45.006989 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0403b8b9-4a88-408d-84a2-384edfa18a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:45.009391 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0403b8b9-4a88-408d-84a2-384edfa18a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023f9c05-65f5-44bd-b072-3c8d6c1feead', 'volume_name': 'volume-023f9c05-65f5-44bd-b072-3c8d6c1feead', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:45.011856 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a61631f-0600-4804-acc7-7196d89c33c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:45.014029 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a61631f-0600-4804-acc7-7196d89c33c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:45.017081 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce32b78e-de40-448e-abf0-49f8c9db5f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:45.017875 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume 023f9c05-65f5-44bd-b072-3c8d6c1feead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023f9c05-65f5-44bd-b072-3c8d6c1feead', 'volume_size': 1} Nov 10 04:03:45.018273 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] creating volume 'volume-023f9c05-65f5-44bd-b072-3c8d6c1feead' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:03:45.019285 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:03:45.127582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:03:45.128279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:03:45.130527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce32b78e-de40-448e-abf0-49f8c9db5f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023f9c05-65f5-44bd-b072-3c8d6c1feead', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:45.143051 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62985cfb-c225-46b7-9be7-312e733e0a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:03:45.170286 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume volume-023f9c05-65f5-44bd-b072-3c8d6c1feead (023f9c05-65f5-44bd-b072-3c8d6c1feead): created successfully Nov 10 04:03:45.172887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62985cfb-c225-46b7-9be7-312e733e0a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:03:45.176728 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Flow 'volume_create_manager' (13efa434-6103-43bb-a1d4-93fbb8fbcd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:03:45.194679 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f00a66be-13f0-409e-801a-da8cf3299418 tempest-TaggedBootDevicesTest_v242-2045997453 None] Created volume successfully. Nov 10 04:04:00.704126 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:04:00.709651 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:04:00.710111 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:04:00.723322 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Flow 'volume_create_manager' (fa58708f-6f27-4d35-bebc-d64c0439847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:04:00.726433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7039fcbb-2362-4506-8bdb-3f8ed7a5846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:00.733592 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:04:00.747798 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7039fcbb-2362-4506-8bdb-3f8ed7a5846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1539991857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=9b6539c1-9cb7-4211-ae44-78f20bd06aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f835c2b6ac5d4c459776f3c69d803eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:04:01Z,use_quota=True,user_id='44dcae1e41bd4ea59252766325d8a092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:00.750517 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771574ae-ebf3-40a6-b28f-7953bf9fad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:00.752924 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771574ae-ebf3-40a6-b28f-7953bf9fad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:00.755820 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239f6930-672d-47c4-a792-441a3e6c1e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:00.758590 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239f6930-672d-47c4-a792-441a3e6c1e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'volume_name': 'volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:00.761090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660eb891-6fc0-4bd4-9ff1-48631c0ecfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:00.763382 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660eb891-6fc0-4bd4-9ff1-48631c0ecfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:00.766131 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac55df6-f04c-4a20-8fc2-112ff9a55e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:00.766911 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Volume 9b6539c1-9cb7-4211-ae44-78f20bd06aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'volume_size': 1} Nov 10 04:04:00.767313 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] creating volume 'volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:04:00.768435 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:00.843514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:04:00.844063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:04:00.847202 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac55df6-f04c-4a20-8fc2-112ff9a55e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:00.850593 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99eb27c7-0d36-49cb-823c-0bea28b0578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:00.862977 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Volume volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6 (9b6539c1-9cb7-4211-ae44-78f20bd06aa6): created successfully Nov 10 04:04:00.866145 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99eb27c7-0d36-49cb-823c-0bea28b0578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:00.872433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Flow 'volume_create_manager' (fa58708f-6f27-4d35-bebc-d64c0439847b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:04:00.885977 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7e3cf479-bc89-431b-8b28-be203ae17968 tempest-VolumesAdminNegativeTest-1107567617 None] Created volume successfully. Nov 10 04:04:01.733973 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-9abd0fb3-888f-41c8-b459-e22862e8068d tempest-TaggedBootDevicesTest_v242-2045997453 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:04:02.674060 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-225de176-30a7-4333-81f0-03c224c512e1 req-f24e6a3b-2443-4e17-b325-c4789fdfed6f tempest-VolumesAdminNegativeTest-1107567617 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:04:02.768124 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-9abd0fb3-888f-41c8-b459-e22862e8068d tempest-TaggedBootDevicesTest_v242-2045997453 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.034s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:04:02.770475 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-9abd0fb3-888f-41c8-b459-e22862e8068d tempest-TaggedBootDevicesTest_v242-2045997453 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c4fda05b-2142-46a3-bbce-e8f084f23384', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'c4fda05b-2142-46a3-bbce-e8f084f23384', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:04:02.813016 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-9abd0fb3-888f-41c8-b459-e22862e8068d tempest-TaggedBootDevicesTest_v242-2045997453 None] Connection info returned from driver {'name': 'volumes/volume-c4fda05b-2142-46a3-bbce-e8f084f23384', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c4fda05b-2142-46a3-bbce-e8f084f23384', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '30dfaeb8-30f5-4ee8-9c07-fb28bc34ccef'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:04:02.899281 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-9abd0fb3-888f-41c8-b459-e22862e8068d tempest-TaggedBootDevicesTest_v242-2045997453 None] attachment_update completed successfully. Nov 10 04:04:03.522567 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-c9f5c9dc-90c9-4ae3-af3b-22f926abc9e7 tempest-TaggedBootDevicesTest_v242-2045997453 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:04:04.058123 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-225de176-30a7-4333-81f0-03c224c512e1 req-f24e6a3b-2443-4e17-b325-c4789fdfed6f tempest-VolumesAdminNegativeTest-1107567617 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.385s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:04:04.060290 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-225de176-30a7-4333-81f0-03c224c512e1 req-f24e6a3b-2443-4e17-b325-c4789fdfed6f tempest-VolumesAdminNegativeTest-1107567617 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:04:04.094197 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-225de176-30a7-4333-81f0-03c224c512e1 req-f24e6a3b-2443-4e17-b325-c4789fdfed6f tempest-VolumesAdminNegativeTest-1107567617 None] Connection info returned from driver {'name': 'volumes/volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9b6539c1-9cb7-4211-ae44-78f20bd06aa6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2b70d46d-b283-4bbd-afe7-51110b46d725'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:04:04.153103 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-225de176-30a7-4333-81f0-03c224c512e1 req-f24e6a3b-2443-4e17-b325-c4789fdfed6f tempest-VolumesAdminNegativeTest-1107567617 None] attachment_update completed successfully. Nov 10 04:04:04.531528 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-c9f5c9dc-90c9-4ae3-af3b-22f926abc9e7 tempest-TaggedBootDevicesTest_v242-2045997453 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.009s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:04:04.532442 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-c9f5c9dc-90c9-4ae3-af3b-22f926abc9e7 tempest-TaggedBootDevicesTest_v242-2045997453 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e4fbf22b-09b7-4560-9bef-63f164558bde', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'e4fbf22b-09b7-4560-9bef-63f164558bde', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:04:04.569255 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-c9f5c9dc-90c9-4ae3-af3b-22f926abc9e7 tempest-TaggedBootDevicesTest_v242-2045997453 None] Connection info returned from driver {'name': 'volumes/volume-e4fbf22b-09b7-4560-9bef-63f164558bde', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e4fbf22b-09b7-4560-9bef-63f164558bde', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5513be6a-bf35-428e-8aa7-180ca23a0196'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:04:04.637510 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-c9f5c9dc-90c9-4ae3-af3b-22f926abc9e7 tempest-TaggedBootDevicesTest_v242-2045997453 None] attachment_update completed successfully. Nov 10 04:04:04.992754 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-475bca9a-eff3-4ce6-9dbc-4bba54838509 tempest-TaggedBootDevicesTest_v242-2045997453 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:04:05.913134 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-475bca9a-eff3-4ce6-9dbc-4bba54838509 tempest-TaggedBootDevicesTest_v242-2045997453 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.920s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:04:05.913930 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-475bca9a-eff3-4ce6-9dbc-4bba54838509 tempest-TaggedBootDevicesTest_v242-2045997453 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-023f9c05-65f5-44bd-b072-3c8d6c1feead', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '023f9c05-65f5-44bd-b072-3c8d6c1feead', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:04:05.951132 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-475bca9a-eff3-4ce6-9dbc-4bba54838509 tempest-TaggedBootDevicesTest_v242-2045997453 None] Connection info returned from driver {'name': 'volumes/volume-023f9c05-65f5-44bd-b072-3c8d6c1feead', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '023f9c05-65f5-44bd-b072-3c8d6c1feead', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '540d930e-43dc-4f45-b1ca-14e3fefd46c6'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:04:06.012642 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-633bcf61-f29d-4f70-bfcf-5dd9ff2576a2 req-475bca9a-eff3-4ce6-9dbc-4bba54838509 tempest-TaggedBootDevicesTest_v242-2045997453 None] attachment_update completed successfully. Nov 10 04:04:08.468932 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-81729cb5-9da7-433c-a9bd-fa19f35563f4 req-67481295-a7f0-44c7-9772-9f49213a17c8 tempest-VolumesAdminNegativeTest-1107567617 None] Terminate volume connection completed successfully. Nov 10 04:04:08.470140 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-81729cb5-9da7-433c-a9bd-fa19f35563f4 req-67481295-a7f0-44c7-9772-9f49213a17c8 tempest-VolumesAdminNegativeTest-1107567617 None] Deleting attachment 2b70d46d-b283-4bbd-afe7-51110b46d725. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:04:09.380302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:04:09.395963 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:04:09.396838 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:04:09.414222 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Flow 'volume_create_manager' (cf813dbe-69c6-46e9-a080-2e8896d2f27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:04:09.418643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1e02dc-4d31-479a-863f-076a80418a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:09.426915 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:04:09.444945 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1e02dc-4d31-479a-863f-076a80418a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1823553597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b101c823-1b2e-48e2-b051-73ecc5d3a3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f835c2b6ac5d4c459776f3c69d803eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:04:09Z,use_quota=True,user_id='44dcae1e41bd4ea59252766325d8a092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:09.448901 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0653caf-bf84-4135-b809-07d269e946cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:09.451734 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0653caf-bf84-4135-b809-07d269e946cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:09.457017 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bb456b-0257-4c72-9a15-079a87c547b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:09.461101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bb456b-0257-4c72-9a15-079a87c547b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b101c823-1b2e-48e2-b051-73ecc5d3a3ef', 'volume_name': 'volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:09.463974 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bdab22-9840-459c-bf8c-8df900b87e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:09.468312 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23bdab22-9840-459c-bf8c-8df900b87e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:09.471186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b645cc8a-db9c-4189-8a36-1d969df2aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:09.472059 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Volume b101c823-1b2e-48e2-b051-73ecc5d3a3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef', 'volume_size': 1} Nov 10 04:04:09.472526 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] creating volume 'volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:04:09.473712 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:09.578183 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:04:09.578671 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:04:09.582004 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b645cc8a-db9c-4189-8a36-1d969df2aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:09.584467 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca24bb-8542-4c9e-a8e1-fd788d36fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:04:09.597554 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Volume volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef (b101c823-1b2e-48e2-b051-73ecc5d3a3ef): created successfully Nov 10 04:04:09.601443 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca24bb-8542-4c9e-a8e1-fd788d36fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:04:09.606920 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Flow 'volume_create_manager' (cf813dbe-69c6-46e9-a080-2e8896d2f27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:04:09.623007 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7539b635-764b-48a4-909a-4089609fe75a tempest-VolumesAdminNegativeTest-1107567617 None] Created volume successfully. Nov 10 04:04:10.517287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] Lock "b'cinder-b101c823-1b2e-48e2-b051-73ecc5d3a3ef-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:04:10.565186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:10.703586 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:04:10.704472 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] Volume volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:04:10.717770 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] deleting rbd volume volume-b101c823-1b2e-48e2-b051-73ecc5d3a3ef {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:04:11.178297 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] Created reservations ['4f8d19ae-e1c0-4612-912c-598bcabe78d1', '5637975c-2434-4168-970d-a0d931616548', 'ed534257-587e-459a-82b5-a6fb2401eba2', 'f9460038-f1ed-4557-8268-a26e1ded568e'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:04:11.246653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:11.312834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:11.383326 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:04:11.393139 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] Deleted volume successfully. Nov 10 04:04:11.414201 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-d3f06755-bdfc-47fc-b09c-c22f9499ed77 tempest-VolumesAdminNegativeTest-1107567617 None] Lock "b'cinder-b101c823-1b2e-48e2-b051-73ecc5d3a3ef-delete_volume'" released by "delete_volume" :: held 0.897s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:04:11.681723 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] Lock "b'cinder-9b6539c1-9cb7-4211-ae44-78f20bd06aa6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:04:11.745718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:11.845897 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:04:11.847897 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] Volume volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:04:11.862718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] deleting rbd volume volume-9b6539c1-9cb7-4211-ae44-78f20bd06aa6 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:04:12.305302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] Created reservations ['deb57295-b139-413e-81e1-76cae88208fb', 'e3f344b3-63f5-4cb6-a0fb-7092826c9e9b', 'a03e92a3-2b54-4daf-8944-0d786340022b', 'bfa6f054-7ea7-4faa-a103-888aa21d8576'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:04:12.380429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:12.450067 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:12.544065 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:04:12.548151 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] Deleted volume successfully. Nov 10 04:04:12.566533 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-92b7f919-c604-424f-ad25-853c3f06183c tempest-VolumesAdminNegativeTest-1107567617 None] Lock "b'cinder-9b6539c1-9cb7-4211-ae44-78f20bd06aa6-delete_volume'" released by "delete_volume" :: held 0.885s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:04:28.542819 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:04:28.546720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:28.609074 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:04:28.664016 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:05:04.682519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:05:04.688067 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:05:04.689078 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:05:04.704055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Flow 'volume_create_manager' (3a6ee246-1a06-4910-ad21-61ae2b6073e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:05:04.707255 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3406e766-1a47-4ae5-80c2-3c02dbc8f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:04.714504 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:05:04.731967 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3406e766-1a47-4ae5-80c2-3c02dbc8f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-289102854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=aece9cdf-8907-47dd-a7bc-d0f1b7cd3034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676f4ec86b44df399be6886b57d34f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:05:05Z,use_quota=True,user_id='4b20a09147544f20941d8afd17c21e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:04.735031 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7a3a7e-c872-430b-bc27-fc19ff405e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:04.737414 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7a3a7e-c872-430b-bc27-fc19ff405e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:04.739871 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e494148-2140-4f59-9111-f447ae1d1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:04.742302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e494148-2140-4f59-9111-f447ae1d1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'volume_name': 'volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:04.745347 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6bd8f3-f9e9-4b57-9909-8f28b3009e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:04.748154 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6bd8f3-f9e9-4b57-9909-8f28b3009e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:04.751030 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128bd41-af37-4d93-b363-97f1e39e8b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:04.752167 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume aece9cdf-8907-47dd-a7bc-d0f1b7cd3034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'volume_size': 1} Nov 10 04:05:04.752803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] creating volume 'volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:05:04.753808 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:05:04.823848 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:05:04.830877 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:05:04.832997 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128bd41-af37-4d93-b363-97f1e39e8b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:04.835107 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c217c8b9-9dad-4811-a93b-0e89679a8e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:04.844556 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034 (aece9cdf-8907-47dd-a7bc-d0f1b7cd3034): created successfully Nov 10 04:05:04.847060 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c217c8b9-9dad-4811-a93b-0e89679a8e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:04.850266 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Flow 'volume_create_manager' (3a6ee246-1a06-4910-ad21-61ae2b6073e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:05:04.859589 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d957d0a0-4d5c-4f28-924f-421923aabb8d tempest-LiveAutoBlockMigrationV225Test-431424804 None] Created volume successfully. Nov 10 04:05:06.590709 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-700cf38b-608e-4999-b6a4-66b5e0cbf22a req-0bc3ea5c-bbba-4b4a-bd82-2adfd521a035 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:05:07.678259 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-700cf38b-608e-4999-b6a4-66b5e0cbf22a req-0bc3ea5c-bbba-4b4a-bd82-2adfd521a035 tempest-LiveAutoBlockMigrationV225Test-431424804 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.087s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:05:07.680072 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-700cf38b-608e-4999-b6a4-66b5e0cbf22a req-0bc3ea5c-bbba-4b4a-bd82-2adfd521a035 tempest-LiveAutoBlockMigrationV225Test-431424804 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:05:07.746883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-700cf38b-608e-4999-b6a4-66b5e0cbf22a req-0bc3ea5c-bbba-4b4a-bd82-2adfd521a035 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Connection info returned from driver {'name': 'volumes/volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c4555569-0f75-49a0-bc11-f2caca4ad9cf'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:05:07.863186 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-700cf38b-608e-4999-b6a4-66b5e0cbf22a req-0bc3ea5c-bbba-4b4a-bd82-2adfd521a035 tempest-LiveAutoBlockMigrationV225Test-431424804 None] attachment_update completed successfully. Nov 10 04:05:15.855527 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-6bb75d8e-a273-49d7-98b3-c3d00ae5c9fc tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:05:16.878541 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-6bb75d8e-a273-49d7-98b3-c3d00ae5c9fc tempest-LiveAutoBlockMigrationV225Test-2001806241 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.022s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:05:16.880139 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-6bb75d8e-a273-49d7-98b3-c3d00ae5c9fc tempest-LiveAutoBlockMigrationV225Test-2001806241 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:05:16.928310 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-6bb75d8e-a273-49d7-98b3-c3d00ae5c9fc tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Connection info returned from driver {'name': 'volumes/volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aece9cdf-8907-47dd-a7bc-d0f1b7cd3034', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4c401dee-f12c-479e-85c9-b898d9009c26'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:05:17.038050 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-6bb75d8e-a273-49d7-98b3-c3d00ae5c9fc tempest-LiveAutoBlockMigrationV225Test-2001806241 None] attachment_update completed successfully. Nov 10 04:05:26.718825 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-8887de99-b45c-4287-bf51-14a0fc3116ba tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Terminate volume connection completed successfully. Nov 10 04:05:26.719541 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-9b6d72b7-0dd6-4e08-97fb-635997065b24 req-8887de99-b45c-4287-bf51-14a0fc3116ba tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Deleting attachment c4555569-0f75-49a0-bc11-f2caca4ad9cf. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:05:28.545020 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:05:28.547120 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:05:28.665838 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:05:28.748715 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:05:34.972352 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-97bcd23d-09de-43ce-af88-13fcab562570 req-be614160-b8d5-4ba6-bceb-4b39f3b589ee tempest-LiveAutoBlockMigrationV225Test-431424804 None] Terminate volume connection completed successfully. Nov 10 04:05:34.973321 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-97bcd23d-09de-43ce-af88-13fcab562570 req-be614160-b8d5-4ba6-bceb-4b39f3b589ee tempest-LiveAutoBlockMigrationV225Test-431424804 None] Deleting attachment 4c401dee-f12c-479e-85c9-b898d9009c26. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:05:36.840013 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:05:36.860678 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:05:36.862425 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:05:36.897946 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Flow 'volume_create_manager' (85d54217-fa9a-4319-ba43-99d9bfc168e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:05:36.908917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2d6a7f-aabf-4920-8b68-e154db9d3294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:36.937618 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:05:36.957483 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2d6a7f-aabf-4920-8b68-e154db9d3294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-771937701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=50f71b27-09e2-463d-b53a-be2fd002b6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676f4ec86b44df399be6886b57d34f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:05:37Z,use_quota=True,user_id='4b20a09147544f20941d8afd17c21e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:36.972194 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f95dda9-1d39-4d3e-bdcf-a262e73f2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:36.974974 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f95dda9-1d39-4d3e-bdcf-a262e73f2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:36.979601 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1bfdd-d80d-4bc9-973b-f306fb65470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:37.248917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1bfdd-d80d-4bc9-973b-f306fb65470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50f71b27-09e2-463d-b53a-be2fd002b6f8', 'volume_name': 'volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:37.251505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da16184a-eefa-4b9f-85a7-55bef696bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:37.253746 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da16184a-eefa-4b9f-85a7-55bef696bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:37.262020 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92177f8c-ff35-4235-a5d0-a5ca6cf3bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:37.263177 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume 50f71b27-09e2-463d-b53a-be2fd002b6f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:05:37.263773 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Cloning 50f71b27-09e2-463d-b53a-be2fd002b6f8 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:05:37.287358 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:05:37.318446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 5, 37, 299535)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:05:37.319404 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:05:37.320004 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:05:37.330983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:05:37.336974 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:05:37.348632 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 5, 37, 343944)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:05:37.349074 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:05:37.352025 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:05:37.382840 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:05:37.489984 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] creating snapshot='volume-50f71b27-09e2-463d-b53a-be2fd002b6f8.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:05:37.750230 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-50f71b27-09e2-463d-b53a-be2fd002b6f8.clone_snap' to 'volume-50f71b27-09e2-463d-b53a-be2fd002b6f8' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:05:38.068138 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:05:38.070301 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:05:38.070675 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:05:38.152037 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:05:38.152878 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Marking volume 50f71b27-09e2-463d-b53a-be2fd002b6f8 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:05:38.165103 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 50f71b27-09e2-463d-b53a-be2fd002b6f8. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:05:38.169914 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Creating volume glance metadata for volume 50f71b27-09e2-463d-b53a-be2fd002b6f8 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:05:38.343775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92177f8c-ff35-4235-a5d0-a5ca6cf3bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:38.361659 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861d4865-2657-451e-9b5a-b2937ab1a5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:05:38.399906 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume volume-50f71b27-09e2-463d-b53a-be2fd002b6f8 (50f71b27-09e2-463d-b53a-be2fd002b6f8): created successfully Nov 10 04:05:38.402754 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861d4865-2657-451e-9b5a-b2937ab1a5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:05:38.408080 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Flow 'volume_create_manager' (85d54217-fa9a-4319-ba43-99d9bfc168e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:05:38.427149 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-47a77418-79d0-4947-af23-9d0b70c9a354 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Created volume successfully. Nov 10 04:05:42.563471 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-5440bd34-f443-4d51-b71c-00225f19ba8e req-db22ca40-d3b1-4209-a67b-4516cfd14df0 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:05:43.787597 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-5440bd34-f443-4d51-b71c-00225f19ba8e req-db22ca40-d3b1-4209-a67b-4516cfd14df0 tempest-LiveAutoBlockMigrationV225Test-431424804 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.221s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:05:43.787597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-5440bd34-f443-4d51-b71c-00225f19ba8e req-db22ca40-d3b1-4209-a67b-4516cfd14df0 tempest-LiveAutoBlockMigrationV225Test-431424804 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '50f71b27-09e2-463d-b53a-be2fd002b6f8', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:05:43.817522 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-5440bd34-f443-4d51-b71c-00225f19ba8e req-db22ca40-d3b1-4209-a67b-4516cfd14df0 tempest-LiveAutoBlockMigrationV225Test-431424804 None] Connection info returned from driver {'name': 'volumes/volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '50f71b27-09e2-463d-b53a-be2fd002b6f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '25955bf4-85bd-415b-ab76-ccd9a88dae9f'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:05:43.889222 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-5440bd34-f443-4d51-b71c-00225f19ba8e req-db22ca40-d3b1-4209-a67b-4516cfd14df0 tempest-LiveAutoBlockMigrationV225Test-431424804 None] attachment_update completed successfully. Nov 10 04:06:00.378388 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-03f6dbf6-0a60-4cd3-ad92-5920eb214d4a tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:06:01.789346 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-03f6dbf6-0a60-4cd3-ad92-5920eb214d4a tempest-LiveAutoBlockMigrationV225Test-2001806241 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.410s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:06:01.790677 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-03f6dbf6-0a60-4cd3-ad92-5920eb214d4a tempest-LiveAutoBlockMigrationV225Test-2001806241 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '50f71b27-09e2-463d-b53a-be2fd002b6f8', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:06:01.826302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-03f6dbf6-0a60-4cd3-ad92-5920eb214d4a tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Connection info returned from driver {'name': 'volumes/volume-50f71b27-09e2-463d-b53a-be2fd002b6f8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '50f71b27-09e2-463d-b53a-be2fd002b6f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c9e590d0-38c9-4338-a746-dd0ab22bd1d7'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:06:01.909217 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-03f6dbf6-0a60-4cd3-ad92-5920eb214d4a tempest-LiveAutoBlockMigrationV225Test-2001806241 None] attachment_update completed successfully. Nov 10 04:06:03.252994 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:06:03.265760 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:06:03.267440 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:06:03.289403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Flow 'volume_create_manager' (115dcdb8-9b88-497e-9c33-9080620da8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:03.297303 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e226c1-24f2-40b7-a0b2-c1a16eb5f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:03.310995 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:06:03.346950 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e226c1-24f2-40b7-a0b2-c1a16eb5f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1981250645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=a8e90acc-c210-4e85-9548-5aba391da3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922909b8fd6a4f5abf9817fc893e8e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:06:03Z,use_quota=True,user_id='96d29211fc5841fda3fddea9f63b086c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:03.353110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e7fe90-f55c-4830-936f-c6abaf7ad277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:03.358588 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e7fe90-f55c-4830-936f-c6abaf7ad277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:03.361447 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51583dd7-bb96-4582-b944-a81cf18395d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:03.364028 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51583dd7-bb96-4582-b944-a81cf18395d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e90acc-c210-4e85-9548-5aba391da3d2', 'volume_name': 'volume-a8e90acc-c210-4e85-9548-5aba391da3d2', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:03.366599 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91c6d30-7378-4deb-ba5d-594d60399e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:03.369062 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91c6d30-7378-4deb-ba5d-594d60399e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:03.372829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6f365-1e44-47c7-8fab-49c675bdafa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:03.373902 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume a8e90acc-c210-4e85-9548-5aba391da3d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e90acc-c210-4e85-9548-5aba391da3d2', 'volume_size': 1} Nov 10 04:06:03.374557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] creating volume 'volume-a8e90acc-c210-4e85-9548-5aba391da3d2' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:06:03.375941 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:03.518198 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:06:03.531872 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:06:03.535867 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6f365-1e44-47c7-8fab-49c675bdafa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e90acc-c210-4e85-9548-5aba391da3d2', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:03.540708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7338a6b-f66e-4453-9475-d53d84dcfa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:03.562883 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume volume-a8e90acc-c210-4e85-9548-5aba391da3d2 (a8e90acc-c210-4e85-9548-5aba391da3d2): created successfully Nov 10 04:06:03.566791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7338a6b-f66e-4453-9475-d53d84dcfa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:03.570980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Flow 'volume_create_manager' (115dcdb8-9b88-497e-9c33-9080620da8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:03.584074 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-66b4d9a8-1d5e-4499-9906-67c145bc4162 tempest-ServerRescueNegativeTestJSON-2136012279 None] Created volume successfully. Nov 10 04:06:18.915769 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-c85a80d0-d5e6-4de5-9c95-f7d26601f322 tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Terminate volume connection completed successfully. Nov 10 04:06:18.916485 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-aba5b144-6251-4cf1-b959-fe5b0e5b3826 req-c85a80d0-d5e6-4de5-9c95-f7d26601f322 tempest-LiveAutoBlockMigrationV225Test-2001806241 None] Deleting attachment 25955bf4-85bd-415b-ab76-ccd9a88dae9f. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:06:22.517399 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:06:22.521611 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:06:22.522090 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:06:22.535359 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Flow 'volume_create_manager' (ca966422-db44-4a56-bd6a-8b821521b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:22.538505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8142433-60c9-4275-9b51-50ec8534c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:22.545961 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:06:22.559001 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8142433-60c9-4275-9b51-50ec8534c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-306195705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=5aecdadd-62f7-4e84-bcaf-ef9136abd296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d2add7649d478b822e887bff3db0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:06:22Z,use_quota=True,user_id='f900805fbd3e4508bb42f780bf00491f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:22.561658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafe006e-605c-450f-ae23-72600d74ded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:22.563589 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafe006e-605c-450f-ae23-72600d74ded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:22.565926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3ff556-6284-4ce2-8bb9-cc878defbfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:22.568063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3ff556-6284-4ce2-8bb9-cc878defbfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'volume_name': 'volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:22.570304 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e0fa25-4d7e-4da3-b8ce-93c79fa4bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:22.572332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e0fa25-4d7e-4da3-b8ce-93c79fa4bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:22.574962 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bcf590-3d63-472e-9796-cb27709318ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:22.575726 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Volume 5aecdadd-62f7-4e84-bcaf-ef9136abd296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'volume_size': 1} Nov 10 04:06:22.576120 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] creating volume 'volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:06:22.577118 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:22.628764 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:06:22.629146 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:06:22.631155 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bcf590-3d63-472e-9796-cb27709318ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:22.633365 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58264298-0ece-4b42-9ce2-cfa2d387b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:22.642268 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Volume volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296 (5aecdadd-62f7-4e84-bcaf-ef9136abd296): created successfully Nov 10 04:06:22.644092 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58264298-0ece-4b42-9ce2-cfa2d387b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:22.647044 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Flow 'volume_create_manager' (ca966422-db44-4a56-bd6a-8b821521b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:22.655222 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5f925631-3376-455b-8b2d-4b88904b19fd tempest-AttachSCSIVolumeTestJSON-1077521481 None] Created volume successfully. Nov 10 04:06:23.403429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:06:23.407315 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:06:23.407806 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:06:23.419900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Flow 'volume_create_manager' (5c84d8f2-3a92-4271-898e-a6f1effc4d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:23.423066 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e086f60c-7241-4e52-824b-529fd7814ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:23.432236 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:06:23.450968 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e086f60c-7241-4e52-824b-529fd7814ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1686031071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=09060a6c-1ebf-4b0e-9730-06caf32b273a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922909b8fd6a4f5abf9817fc893e8e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:06:23Z,use_quota=True,user_id='96d29211fc5841fda3fddea9f63b086c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:23.453469 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9f9183-15ba-4ce0-9d45-11da5f608821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:23.455756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9f9183-15ba-4ce0-9d45-11da5f608821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:23.460090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b05589-ef69-4d69-a00a-880348321822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:23.462855 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b05589-ef69-4d69-a00a-880348321822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09060a6c-1ebf-4b0e-9730-06caf32b273a', 'volume_name': 'volume-09060a6c-1ebf-4b0e-9730-06caf32b273a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:23.465264 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b9a0a6-2579-4110-8d35-e947d2ebee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:23.467278 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b9a0a6-2579-4110-8d35-e947d2ebee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:23.469468 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ebc523-08dc-4257-891c-779917e51726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:23.470237 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume 09060a6c-1ebf-4b0e-9730-06caf32b273a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09060a6c-1ebf-4b0e-9730-06caf32b273a', 'volume_size': 1} Nov 10 04:06:23.470825 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] creating volume 'volume-09060a6c-1ebf-4b0e-9730-06caf32b273a' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:06:23.472000 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:23.568980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:06:23.570470 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:06:23.575658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ebc523-08dc-4257-891c-779917e51726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09060a6c-1ebf-4b0e-9730-06caf32b273a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:23.578719 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8594e19-11fd-46e6-b3ac-1910bd3d7444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:23.591109 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume volume-09060a6c-1ebf-4b0e-9730-06caf32b273a (09060a6c-1ebf-4b0e-9730-06caf32b273a): created successfully Nov 10 04:06:23.597223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8594e19-11fd-46e6-b3ac-1910bd3d7444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:23.603760 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Flow 'volume_create_manager' (5c84d8f2-3a92-4271-898e-a6f1effc4d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:23.613172 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-86ec297d-06df-4f7c-ba56-1d5d680653d2 tempest-ServerRescueNegativeTestJSON-2136012279 None] Created volume successfully. Nov 10 04:06:23.698765 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-3fb0c09b-c837-4a46-85fe-e34831b5245f tempest-LiveAutoBlockMigrationV225Test-431424804 None] Terminate volume connection completed successfully. Nov 10 04:06:23.700204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-3fb0c09b-c837-4a46-85fe-e34831b5245f tempest-LiveAutoBlockMigrationV225Test-431424804 None] Deleting attachment c9e590d0-38c9-4338-a746-dd0ab22bd1d7. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:06:23.920131 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] Lock "b'cinder-50f71b27-09e2-463d-b53a-be2fd002b6f8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:06:23.974628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:24.093726 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:06:24.103643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] deleting rbd volume volume-50f71b27-09e2-463d-b53a-be2fd002b6f8 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:06:24.163725 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-8fe87f0d-bec2-494e-871e-bf5ba88f50eb req-88537f32-fa0a-4f37-8351-cbe1ae28ffe7 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:06:24.549964 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:06:24.599918 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] deleting parent snapshot volume-50f71b27-09e2-463d-b53a-be2fd002b6f8.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:06:25.723100 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-8fe87f0d-bec2-494e-871e-bf5ba88f50eb req-88537f32-fa0a-4f37-8351-cbe1ae28ffe7 tempest-AttachSCSIVolumeTestJSON-1077521481 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.560s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:06:25.725451 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-8fe87f0d-bec2-494e-871e-bf5ba88f50eb req-88537f32-fa0a-4f37-8351-cbe1ae28ffe7 tempest-AttachSCSIVolumeTestJSON-1077521481 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:06:25.774582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] Lock "b'cinder-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034-delete_volume'" acquired by "delete_volume" :: waited 0.058s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:06:25.801953 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-8fe87f0d-bec2-494e-871e-bf5ba88f50eb req-88537f32-fa0a-4f37-8351-cbe1ae28ffe7 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Connection info returned from driver {'name': 'volumes/volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5aecdadd-62f7-4e84-bcaf-ef9136abd296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1f1ab5ac-f480-4bda-9052-9c35cac68eb0'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:06:25.814496 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] Created reservations ['0ccf08c3-0a42-46f3-8ce2-bcb7073dfb38', 'e20681e5-846f-4bb9-85c4-0235735c040f', '43e993a7-327a-4dfd-961c-94f11e735abc', 'ae135be0-b7cf-4196-a740-93e56065f367'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:06:25.862475 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-2f295d75-0060-4135-aecd-6f69f5622781 req-7e642eda-afaf-4357-bd6c-4e263a528bb8 tempest-ServerRescueNegativeTestJSON-2136012279 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:06:25.909429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:25.972714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:06:25.973223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] Volume volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:06:25.990827 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] deleting rbd volume volume-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:06:26.061666 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-8fe87f0d-bec2-494e-871e-bf5ba88f50eb req-88537f32-fa0a-4f37-8351-cbe1ae28ffe7 tempest-AttachSCSIVolumeTestJSON-1077521481 None] attachment_update completed successfully. Nov 10 04:06:26.067868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:26.112237 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:26.173382 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:06:26.180787 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] Deleted volume successfully. Nov 10 04:06:26.226885 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-17a5237f-fe8b-4328-ae76-ecf568d5f007 req-20115f5a-4a9c-4ef2-bd1a-7820e96c75ae tempest-LiveAutoBlockMigrationV225Test-431424804 None] Lock "b'cinder-50f71b27-09e2-463d-b53a-be2fd002b6f8-delete_volume'" released by "delete_volume" :: held 2.307s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:06:26.616776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] Created reservations ['8f02acc4-d857-4603-b9ac-d84b9f0ec176', '0f619d6d-3580-4e85-8df8-ae19ef1cc149', '77b0b6ba-dfd3-4929-8cb4-e52484211a30', 'a8255bc2-661f-4d93-80ef-7dbb955ccfc7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:06:26.693707 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:26.757080 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:26.800750 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:06:26.803444 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-2f295d75-0060-4135-aecd-6f69f5622781 req-7e642eda-afaf-4357-bd6c-4e263a528bb8 tempest-ServerRescueNegativeTestJSON-2136012279 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.941s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:06:26.804110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-2f295d75-0060-4135-aecd-6f69f5622781 req-7e642eda-afaf-4357-bd6c-4e263a528bb8 tempest-ServerRescueNegativeTestJSON-2136012279 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-09060a6c-1ebf-4b0e-9730-06caf32b273a', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '09060a6c-1ebf-4b0e-9730-06caf32b273a', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:06:26.809395 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] Deleted volume successfully. Nov 10 04:06:26.846616 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-2f295d75-0060-4135-aecd-6f69f5622781 req-7e642eda-afaf-4357-bd6c-4e263a528bb8 tempest-ServerRescueNegativeTestJSON-2136012279 None] Connection info returned from driver {'name': 'volumes/volume-09060a6c-1ebf-4b0e-9730-06caf32b273a', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '09060a6c-1ebf-4b0e-9730-06caf32b273a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cedf11a5-997d-4622-a6b3-da9774325270'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:06:26.853840 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3b468f67-7de4-4aeb-953d-2220630b364e tempest-LiveAutoBlockMigrationV225Test-431424804 None] Lock "b'cinder-aece9cdf-8907-47dd-a7bc-d0f1b7cd3034-delete_volume'" released by "delete_volume" :: held 1.079s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:06:26.906822 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-2f295d75-0060-4135-aecd-6f69f5622781 req-7e642eda-afaf-4357-bd6c-4e263a528bb8 tempest-ServerRescueNegativeTestJSON-2136012279 None] attachment_update completed successfully. Nov 10 04:06:28.545198 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:06:28.546505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:28.617197 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:28.700906 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:06:29.947975 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-67f8edf5-e6d7-4ada-a204-ed7908e009bc req-67c6d376-0900-4a9d-8738-9f7435b86d57 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Terminate volume connection completed successfully. Nov 10 04:06:29.948882 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-67f8edf5-e6d7-4ada-a204-ed7908e009bc req-67c6d376-0900-4a9d-8738-9f7435b86d57 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Deleting attachment 1f1ab5ac-f480-4bda-9052-9c35cac68eb0. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:06:35.615766 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:06:35.620773 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:06:35.621420 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:06:35.640729 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Flow 'volume_create_manager' (d9011c44-ed81-4733-9672-c49c48f4b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:35.644175 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659799f7-50b6-44a5-bd74-f39d85040d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:35.654023 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:06:35.677456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (659799f7-50b6-44a5-bd74-f39d85040d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1661781170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=88717027-3af9-48fa-b94b-cd4c304810a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa5eb57eed4a08886f209520775cc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:06:36Z,use_quota=True,user_id='de14696cbebe4b6fa15502526d41d82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:35.680769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04300be-7ee3-4c96-9b4b-c1a1fc0813b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:35.683590 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04300be-7ee3-4c96-9b4b-c1a1fc0813b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:35.687348 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53517a65-6faf-4ec3-9972-29339574f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:35.765862 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Lock "b'cinder-5aecdadd-62f7-4e84-bcaf-ef9136abd296-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:06:35.837210 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53517a65-6faf-4ec3-9972-29339574f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '88717027-3af9-48fa-b94b-cd4c304810a8', 'volume_name': 'volume-88717027-3af9-48fa-b94b-cd4c304810a8', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:35.841569 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7b8843-7e28-49c4-a294-3737ba9d526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:35.844029 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7b8843-7e28-49c4-a294-3737ba9d526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:35.846259 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee88742-33a8-4620-98b7-3eec5480270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:35.847625 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Volume 88717027-3af9-48fa-b94b-cd4c304810a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-88717027-3af9-48fa-b94b-cd4c304810a8', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:06:35.848006 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Cloning 88717027-3af9-48fa-b94b-cd4c304810a8 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:06:35.867556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:35.943850 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:06:35.944289 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Volume volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:06:35.952529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] deleting rbd volume volume-5aecdadd-62f7-4e84-bcaf-ef9136abd296 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:06:35.958904 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.110s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:06:35.974274 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 6, 35, 963985)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:06:35.974808 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:06:35.975359 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:06:35.982417 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:06:35.984773 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:06:35.992227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 6, 35, 989846)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:06:35.992923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:06:35.993336 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:06:36.006025 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:36.082330 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] creating snapshot='volume-88717027-3af9-48fa-b94b-cd4c304810a8.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:06:36.599770 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-88717027-3af9-48fa-b94b-cd4c304810a8.clone_snap' to 'volume-88717027-3af9-48fa-b94b-cd4c304810a8' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:06:36.647224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Created reservations ['0d2e9647-6c3f-4f6c-b310-3a3696c2d6d0', '08ab40b1-f0e6-4232-ae9b-cc14394609c6', 'faebe5bc-17d6-429b-bdb8-064d6267043a', 'e33b2626-69bc-4e33-84cc-46af034c4db2'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:06:36.699652 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:36.741027 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:36.772477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:06:36.778385 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Deleted volume successfully. Nov 10 04:06:36.838499 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:06:36.840883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:06:36.841553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:06:36.863433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:06:36.864270 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Marking volume 88717027-3af9-48fa-b94b-cd4c304810a8 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:06:36.879637 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 88717027-3af9-48fa-b94b-cd4c304810a8. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:06:36.881142 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Creating volume glance metadata for volume 88717027-3af9-48fa-b94b-cd4c304810a8 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:06:36.884845 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f149e83b-856e-4af5-8f1e-19783a8cecd8 tempest-AttachSCSIVolumeTestJSON-1077521481 None] Lock "b'cinder-5aecdadd-62f7-4e84-bcaf-ef9136abd296-delete_volume'" released by "delete_volume" :: held 1.119s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:06:36.951498 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee88742-33a8-4620-98b7-3eec5480270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88717027-3af9-48fa-b94b-cd4c304810a8', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:36.953941 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6c2e2f-f709-4005-833a-ca44baf2bf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:06:36.973180 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Volume volume-88717027-3af9-48fa-b94b-cd4c304810a8 (88717027-3af9-48fa-b94b-cd4c304810a8): created successfully Nov 10 04:06:36.975485 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6c2e2f-f709-4005-833a-ca44baf2bf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:06:36.978445 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Flow 'volume_create_manager' (d9011c44-ed81-4733-9672-c49c48f4b927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:06:36.987999 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-246d7349-91d0-4829-9d77-29b2f5151a40 tempest-ServersTestBootFromVolume-1968196142 None] Created volume successfully. Nov 10 04:06:40.331196 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-f7040d28-3666-4bb5-b655-44f2264b95ef req-9ae78b6f-d231-4ff4-be34-5f4969fbd0be tempest-ServersTestBootFromVolume-1968196142 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:06:41.490234 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-f7040d28-3666-4bb5-b655-44f2264b95ef req-9ae78b6f-d231-4ff4-be34-5f4969fbd0be tempest-ServersTestBootFromVolume-1968196142 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.159s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:06:41.491084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-f7040d28-3666-4bb5-b655-44f2264b95ef req-9ae78b6f-d231-4ff4-be34-5f4969fbd0be tempest-ServersTestBootFromVolume-1968196142 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-88717027-3af9-48fa-b94b-cd4c304810a8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '88717027-3af9-48fa-b94b-cd4c304810a8', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:06:41.524595 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-f7040d28-3666-4bb5-b655-44f2264b95ef req-9ae78b6f-d231-4ff4-be34-5f4969fbd0be tempest-ServersTestBootFromVolume-1968196142 None] Connection info returned from driver {'name': 'volumes/volume-88717027-3af9-48fa-b94b-cd4c304810a8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '88717027-3af9-48fa-b94b-cd4c304810a8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1cde655e-6247-4f27-b5e9-2428789a4cdd'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:06:41.605026 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-f7040d28-3666-4bb5-b655-44f2264b95ef req-9ae78b6f-d231-4ff4-be34-5f4969fbd0be tempest-ServersTestBootFromVolume-1968196142 None] attachment_update completed successfully. Nov 10 04:06:53.302322 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-d490c77f-c4f2-46ea-b0f8-933e724343f1 req-dca0b0c5-1a8e-487f-b895-045c7c3e060b tempest-ServerRescueNegativeTestJSON-2136012279 None] Terminate volume connection completed successfully. Nov 10 04:06:53.302949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-d490c77f-c4f2-46ea-b0f8-933e724343f1 req-dca0b0c5-1a8e-487f-b895-045c7c3e060b tempest-ServerRescueNegativeTestJSON-2136012279 None] Deleting attachment cedf11a5-997d-4622-a6b3-da9774325270. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:06:54.167785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] Lock "b'cinder-09060a6c-1ebf-4b0e-9730-06caf32b273a-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:06:54.240862 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:54.316078 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:06:54.317975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume volume-09060a6c-1ebf-4b0e-9730-06caf32b273a is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:06:54.328996 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] deleting rbd volume volume-09060a6c-1ebf-4b0e-9730-06caf32b273a {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:06:54.752773 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] Created reservations ['35be8be7-0349-4615-ad0e-c12ff9514f1e', '60cce931-e580-4eb5-984c-21bda266f067', 'dd65fb4a-ba2b-4036-9830-e85452303e98', '2005760c-32a4-4515-ae91-e6a8fe217c50'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:06:54.831990 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:54.930829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:54.996463 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:06:55.002149 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] Deleted volume successfully. Nov 10 04:06:55.018247 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8256398d-b1a4-497d-b9a1-26a9e8d1df3f tempest-ServerRescueNegativeTestJSON-2136012279 None] Lock "b'cinder-09060a6c-1ebf-4b0e-9730-06caf32b273a-delete_volume'" released by "delete_volume" :: held 0.851s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:06:55.391362 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] Lock "b'cinder-a8e90acc-c210-4e85-9548-5aba391da3d2-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:06:55.476699 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:55.579168 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:06:55.579798 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] Volume volume-a8e90acc-c210-4e85-9548-5aba391da3d2 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:06:55.602822 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] deleting rbd volume volume-a8e90acc-c210-4e85-9548-5aba391da3d2 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:06:55.996713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] Created reservations ['014c3f7c-17db-4b91-8e40-5d10f1af088a', 'ad2e628e-038c-4839-a434-38f626721217', 'b76a734a-d90b-4560-9bd0-3fa244849f50', 'f868e585-a024-4057-894d-72b2badfa0ae'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:06:56.054235 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:56.125474 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:06:56.188217 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:06:56.194371 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] Deleted volume successfully. Nov 10 04:06:56.217140 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5073917a-42ff-4f7a-8b91-33df26698332 tempest-ServerRescueNegativeTestJSON-2136012279 None] Lock "b'cinder-a8e90acc-c210-4e85-9548-5aba391da3d2-delete_volume'" released by "delete_volume" :: held 0.826s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:07:26.559123 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:07:26.566373 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:07:26.567321 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:07:26.581637 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Flow 'volume_create_manager' (997309c2-142c-4f66-a665-62e0c2025237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:07:26.585414 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580374e9-0f97-4a45-8b1b-21930be98b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:26.592942 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:07:26.611332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580374e9-0f97-4a45-8b1b-21930be98b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1455542139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ca044ea8-3bef-4b37-8b7c-68a868d66847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05c03f4e9dc4e1d9e8f759b8f0c7c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:07:26Z,use_quota=True,user_id='885977f4f57f46a2a938d8cd81bdb3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:26.615360 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381942d0-31e7-4e46-9d69-8cf22d25e6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:26.617819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381942d0-31e7-4e46-9d69-8cf22d25e6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:26.620380 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb11a5a7-3389-4e9a-9615-6de804585e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:26.623215 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb11a5a7-3389-4e9a-9615-6de804585e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca044ea8-3bef-4b37-8b7c-68a868d66847', 'volume_name': 'volume-ca044ea8-3bef-4b37-8b7c-68a868d66847', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:26.625848 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75e1119-e55d-4e98-b1ff-6d2a8ccaac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:26.628074 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75e1119-e55d-4e98-b1ff-6d2a8ccaac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:26.630597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530070d1-2525-4fa4-a27c-90e78cb296c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:26.631679 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Volume ca044ea8-3bef-4b37-8b7c-68a868d66847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca044ea8-3bef-4b37-8b7c-68a868d66847', 'volume_size': 1} Nov 10 04:07:26.632489 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] creating volume 'volume-ca044ea8-3bef-4b37-8b7c-68a868d66847' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:07:26.634178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:07:26.765401 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:07:26.765848 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:07:26.767927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530070d1-2525-4fa4-a27c-90e78cb296c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca044ea8-3bef-4b37-8b7c-68a868d66847', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:26.770146 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5293b9eb-9e7b-4d87-922d-63c45353ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:26.792489 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Volume volume-ca044ea8-3bef-4b37-8b7c-68a868d66847 (ca044ea8-3bef-4b37-8b7c-68a868d66847): created successfully Nov 10 04:07:26.795472 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5293b9eb-9e7b-4d87-922d-63c45353ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:26.800122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Flow 'volume_create_manager' (997309c2-142c-4f66-a665-62e0c2025237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:07:26.811073 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-be449012-ad69-43b0-8094-fc57a8deac30 tempest-DeleteServersTestJSON-1714889781 None] Created volume successfully. Nov 10 04:07:28.541437 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:07:28.542465 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:07:28.640745 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:07:28.740716 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:07:29.010629 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-1d4d4849-d875-4b02-bfab-a66d0022a0c3 req-e87515c3-0af7-4139-a2da-652611476f37 tempest-DeleteServersTestJSON-1714889781 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:07:30.177393 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-1d4d4849-d875-4b02-bfab-a66d0022a0c3 req-e87515c3-0af7-4139-a2da-652611476f37 tempest-DeleteServersTestJSON-1714889781 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.169s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:07:30.179253 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1d4d4849-d875-4b02-bfab-a66d0022a0c3 req-e87515c3-0af7-4139-a2da-652611476f37 tempest-DeleteServersTestJSON-1714889781 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ca044ea8-3bef-4b37-8b7c-68a868d66847', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'ca044ea8-3bef-4b37-8b7c-68a868d66847', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:07:30.212097 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-1d4d4849-d875-4b02-bfab-a66d0022a0c3 req-e87515c3-0af7-4139-a2da-652611476f37 tempest-DeleteServersTestJSON-1714889781 None] Connection info returned from driver {'name': 'volumes/volume-ca044ea8-3bef-4b37-8b7c-68a868d66847', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ca044ea8-3bef-4b37-8b7c-68a868d66847', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1f054e0e-0f62-4f5c-b62a-30abe064d0fe'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:07:30.305711 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1d4d4849-d875-4b02-bfab-a66d0022a0c3 req-e87515c3-0af7-4139-a2da-652611476f37 tempest-DeleteServersTestJSON-1714889781 None] attachment_update completed successfully. Nov 10 04:07:31.734437 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:07:31.740368 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:07:31.740933 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:07:31.784266 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Flow 'volume_create_manager' (7849b27a-8f4f-47a6-83d3-587043c8ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:07:31.796540 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e3cbd4-08eb-4cfa-afa2-e542f0299769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:31.810096 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:07:31.834096 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e3cbd4-08eb-4cfa-afa2-e542f0299769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-878389481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1b43c02e-2da9-4fd7-9ff3-ea2417db5d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb3ad32a40543dd84c0805ec7f39b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:07:32Z,use_quota=True,user_id='d009c583f1e547879ada9e3f030cec40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:31.837354 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed68e73-1d86-4a06-91c3-a5bafd336159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:31.840314 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed68e73-1d86-4a06-91c3-a5bafd336159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:31.847681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd232b0f-7abc-47fb-b6a9-08baad9add16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:31.850333 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd232b0f-7abc-47fb-b6a9-08baad9add16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'volume_name': 'volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:31.853555 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e073f5-2cdf-4cfa-8ada-43a0efa0b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:31.857164 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e073f5-2cdf-4cfa-8ada-43a0efa0b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:31.859503 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10aa54a-a6e4-452a-99ab-de2c3df84e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:31.860369 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Volume 1b43c02e-2da9-4fd7-9ff3-ea2417db5d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'volume_size': 1} Nov 10 04:07:31.860850 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] creating volume 'volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:07:31.862161 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:07:31.967349 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:07:31.968642 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:07:31.970997 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10aa54a-a6e4-452a-99ab-de2c3df84e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:31.973977 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4b669c-5768-4463-963f-3b0827db6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:07:31.987116 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Volume volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85 (1b43c02e-2da9-4fd7-9ff3-ea2417db5d85): created successfully Nov 10 04:07:31.989685 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4b669c-5768-4463-963f-3b0827db6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:07:31.993490 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Flow 'volume_create_manager' (7849b27a-8f4f-47a6-83d3-587043c8ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:07:32.007447 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a36c2dd-83ff-4d4f-9135-aecf53c7690a tempest-AttachVolumeNegativeTest-659951714 None] Created volume successfully. Nov 10 04:07:33.330927 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a71b5bb1-4066-4bfd-bcef-7acbebfda851 req-fbaca378-bc35-4c71-a968-17cd25acd106 tempest-AttachVolumeNegativeTest-659951714 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:07:34.180447 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a71b5bb1-4066-4bfd-bcef-7acbebfda851 req-fbaca378-bc35-4c71-a968-17cd25acd106 tempest-AttachVolumeNegativeTest-659951714 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.850s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:07:34.182743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a71b5bb1-4066-4bfd-bcef-7acbebfda851 req-fbaca378-bc35-4c71-a968-17cd25acd106 tempest-AttachVolumeNegativeTest-659951714 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:07:34.222999 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a71b5bb1-4066-4bfd-bcef-7acbebfda851 req-fbaca378-bc35-4c71-a968-17cd25acd106 tempest-AttachVolumeNegativeTest-659951714 None] Connection info returned from driver {'name': 'volumes/volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b43c02e-2da9-4fd7-9ff3-ea2417db5d85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '449a3a55-d943-40fe-84ac-de2ceb9ba44c'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:07:34.299035 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a71b5bb1-4066-4bfd-bcef-7acbebfda851 req-fbaca378-bc35-4c71-a968-17cd25acd106 tempest-AttachVolumeNegativeTest-659951714 None] attachment_update completed successfully. Nov 10 04:07:35.823593 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-e3eefab1-d8a3-4a6f-9c71-771f2abbae76 req-ef30f99b-944b-4793-adb1-a45c587aaeba tempest-DeleteServersTestJSON-1714889781 None] Terminate volume connection completed successfully. Nov 10 04:07:35.825110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-e3eefab1-d8a3-4a6f-9c71-771f2abbae76 req-ef30f99b-944b-4793-adb1-a45c587aaeba tempest-DeleteServersTestJSON-1714889781 None] Deleting attachment 1f054e0e-0f62-4f5c-b62a-30abe064d0fe. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:07:53.242716 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-8253c88d-10d7-46a7-9145-0a054d4cbcc9 req-57e45726-89c0-4577-9b68-0ca620e47201 tempest-AttachVolumeNegativeTest-659951714 None] Terminate volume connection completed successfully. Nov 10 04:07:53.243287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-8253c88d-10d7-46a7-9145-0a054d4cbcc9 req-57e45726-89c0-4577-9b68-0ca620e47201 tempest-AttachVolumeNegativeTest-659951714 None] Deleting attachment 449a3a55-d943-40fe-84ac-de2ceb9ba44c. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:08:06.591327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:08:06.598243 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:08:06.599077 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:08:06.614830 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Flow 'volume_create_manager' (75b5812d-91f4-49ed-862d-2a0bc78a1e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:08:06.619555 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4afe3-2593-48df-b1ca-aeed6fb1df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:06.628960 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:08:06.648934 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4afe3-2593-48df-b1ca-aeed6fb1df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-545662683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ac8dcbd3-f970-4a5c-ac93-c5054527e78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb3ad32a40543dd84c0805ec7f39b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:08:07Z,use_quota=True,user_id='d009c583f1e547879ada9e3f030cec40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:06.653285 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c04963-9d4a-4775-af3b-e89fdd24041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:06.656000 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c04963-9d4a-4775-af3b-e89fdd24041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:06.659377 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd0784a-61fa-4d7b-8b46-3b945a180092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:06.662612 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd0784a-61fa-4d7b-8b46-3b945a180092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'volume_name': 'volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:06.667966 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3eb8b3-c735-444e-b773-80e6c77a606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:06.671558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3eb8b3-c735-444e-b773-80e6c77a606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:06.674373 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6f5cc0-1048-4abc-9408-6cc35b64ef43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:06.675343 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Volume ac8dcbd3-f970-4a5c-ac93-c5054527e78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'volume_size': 1} Nov 10 04:08:06.675965 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] creating volume 'volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:08:06.677298 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:06.762199 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:08:06.763902 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:08:06.764815 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6f5cc0-1048-4abc-9408-6cc35b64ef43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:06.766996 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5127a895-1ae6-431c-bf65-5f29f645d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:06.781413 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Volume volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b (ac8dcbd3-f970-4a5c-ac93-c5054527e78b): created successfully Nov 10 04:08:06.783718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5127a895-1ae6-431c-bf65-5f29f645d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:06.786853 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Flow 'volume_create_manager' (75b5812d-91f4-49ed-862d-2a0bc78a1e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:08:06.800764 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-08674a68-e795-4306-86e2-9e2eb676ba10 tempest-AttachVolumeNegativeTest-659951714 None] Created volume successfully. Nov 10 04:08:08.391712 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-fbde6022-4614-45d5-a884-cb970ac12efb req-b80ad2b2-edd8-42d6-8e22-69ec8df5397b tempest-AttachVolumeNegativeTest-659951714 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:08:09.131319 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-fbde6022-4614-45d5-a884-cb970ac12efb req-b80ad2b2-edd8-42d6-8e22-69ec8df5397b tempest-AttachVolumeNegativeTest-659951714 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.739s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:08:09.132252 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-fbde6022-4614-45d5-a884-cb970ac12efb req-b80ad2b2-edd8-42d6-8e22-69ec8df5397b tempest-AttachVolumeNegativeTest-659951714 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:08:09.155815 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-fbde6022-4614-45d5-a884-cb970ac12efb req-b80ad2b2-edd8-42d6-8e22-69ec8df5397b tempest-AttachVolumeNegativeTest-659951714 None] Connection info returned from driver {'name': 'volumes/volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ac8dcbd3-f970-4a5c-ac93-c5054527e78b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '13bef914-0c6d-47ed-bb81-cc2163578e33'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:08:09.220335 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-fbde6022-4614-45d5-a884-cb970ac12efb req-b80ad2b2-edd8-42d6-8e22-69ec8df5397b tempest-AttachVolumeNegativeTest-659951714 None] attachment_update completed successfully. Nov 10 04:08:12.791817 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-ff9b5506-50df-4cf4-abc2-7d5ff0320eeb req-8d99c434-8d5e-48bf-8907-b3b7adbf3dfd tempest-AttachVolumeNegativeTest-659951714 None] Terminate volume connection completed successfully. Nov 10 04:08:12.793665 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-ff9b5506-50df-4cf4-abc2-7d5ff0320eeb req-8d99c434-8d5e-48bf-8907-b3b7adbf3dfd tempest-AttachVolumeNegativeTest-659951714 None] Deleting attachment 13bef914-0c6d-47ed-bb81-cc2163578e33. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:08:25.639347 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a2069c24-52d5-4e53-a6bd-c3daf0101b9e req-19087182-0c42-425d-8acc-c7bc2772db3f tempest-TaggedBootDevicesTest-2048337972 None] Terminate volume connection completed successfully. Nov 10 04:08:25.640396 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a2069c24-52d5-4e53-a6bd-c3daf0101b9e req-19087182-0c42-425d-8acc-c7bc2772db3f tempest-TaggedBootDevicesTest-2048337972 None] Deleting attachment 6aee0489-c1fe-4a04-9853-f33db8c76b54. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:08:25.744027 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a2069c24-52d5-4e53-a6bd-c3daf0101b9e req-d69faec4-23d2-4b89-a627-5129b90b7165 tempest-TaggedBootDevicesTest-2048337972 None] Terminate volume connection completed successfully. Nov 10 04:08:25.744446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a2069c24-52d5-4e53-a6bd-c3daf0101b9e req-d69faec4-23d2-4b89-a627-5129b90b7165 tempest-TaggedBootDevicesTest-2048337972 None] Deleting attachment 71039112-ad5f-4084-a756-2cad63009234. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:08:25.850174 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a2069c24-52d5-4e53-a6bd-c3daf0101b9e req-ef4845b3-39c7-462a-85b1-d03ffed34c0e tempest-TaggedBootDevicesTest-2048337972 None] Terminate volume connection completed successfully. Nov 10 04:08:25.850590 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a2069c24-52d5-4e53-a6bd-c3daf0101b9e req-ef4845b3-39c7-462a-85b1-d03ffed34c0e tempest-TaggedBootDevicesTest-2048337972 None] Deleting attachment 7c722539-710c-4be9-ac8c-ff5ed01d3a72. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:08:28.365615 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:08:28.372465 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:08:28.373226 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:08:28.391262 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Flow 'volume_create_manager' (f9f95fd2-877c-467b-90c2-3b8cd41bbcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:08:28.396842 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01c6ac7-8f23-4548-8a9e-5c2387f87791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:28.403989 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:08:28.419634 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01c6ac7-8f23-4548-8a9e-5c2387f87791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1269469050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=d297f4e1-6b88-4c30-a5c4-dbd4648142fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb3ad32a40543dd84c0805ec7f39b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:08:28Z,use_quota=True,user_id='d009c583f1e547879ada9e3f030cec40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:28.422429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342afae6-d027-4e9a-9cef-e8a0f7df87ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:28.424882 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342afae6-d027-4e9a-9cef-e8a0f7df87ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:28.427357 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd557a50-cb0e-47d9-ae71-4991c0245c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:28.429785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd557a50-cb0e-47d9-ae71-4991c0245c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'volume_name': 'volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:28.432871 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52551c8e-5f06-4ce7-a4f9-b5a6589be830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:28.435011 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52551c8e-5f06-4ce7-a4f9-b5a6589be830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:28.438027 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2778fed3-01f5-465b-83dc-85d00bc34820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:28.440301 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Volume d297f4e1-6b88-4c30-a5c4-dbd4648142fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'volume_size': 1} Nov 10 04:08:28.440767 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] creating volume 'volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:08:28.442098 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:28.504583 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:08:28.505276 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:08:28.507412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2778fed3-01f5-465b-83dc-85d00bc34820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:28.509648 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266e120d-a62c-43e2-ad6c-03f43bba1560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:28.519961 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Volume volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe (d297f4e1-6b88-4c30-a5c4-dbd4648142fe): created successfully Nov 10 04:08:28.522064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266e120d-a62c-43e2-ad6c-03f43bba1560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:28.525591 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Flow 'volume_create_manager' (f9f95fd2-877c-467b-90c2-3b8cd41bbcfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:08:28.535237 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-45308a0f-895d-46ee-85dd-d82d9853861c tempest-AttachVolumeNegativeTest-659951714 None] Created volume successfully. Nov 10 04:08:28.544069 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:08:28.544914 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:28.580309 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:28.617418 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:29.991681 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-51aa05e1-eef7-4433-be4a-a3ca0ec3908a req-586987be-80f6-4317-ae8a-9118c55a0180 tempest-AttachVolumeNegativeTest-659951714 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:08:30.778511 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-51aa05e1-eef7-4433-be4a-a3ca0ec3908a req-586987be-80f6-4317-ae8a-9118c55a0180 tempest-AttachVolumeNegativeTest-659951714 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.786s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:08:30.780071 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-51aa05e1-eef7-4433-be4a-a3ca0ec3908a req-586987be-80f6-4317-ae8a-9118c55a0180 tempest-AttachVolumeNegativeTest-659951714 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'd297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:08:30.838743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-51aa05e1-eef7-4433-be4a-a3ca0ec3908a req-586987be-80f6-4317-ae8a-9118c55a0180 tempest-AttachVolumeNegativeTest-659951714 None] Connection info returned from driver {'name': 'volumes/volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd297f4e1-6b88-4c30-a5c4-dbd4648142fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'af51c555-2650-4a70-9b1f-7985c2553fd5'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:08:30.895353 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-51aa05e1-eef7-4433-be4a-a3ca0ec3908a req-586987be-80f6-4317-ae8a-9118c55a0180 tempest-AttachVolumeNegativeTest-659951714 None] attachment_update completed successfully. Nov 10 04:08:32.158438 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-c41b9c83-4795-4424-b391-4f7b0d7c533f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:08:32.211115 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:32.290349 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:08:32.290725 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-c41b9c83-4795-4424-b391-4f7b0d7c533f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:08:32.296222 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] deleting rbd volume volume-c41b9c83-4795-4424-b391-4f7b0d7c533f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:08:32.574664 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] Created reservations ['2ee6e2bb-1868-4cc6-8510-009929b7c78a', 'a6cbc203-2b21-40e8-b016-99f9861857a4', '384d2a89-bad4-4b7b-9256-fe7fa5540089', '4b606243-ac5d-4cc4-810d-2123d8c5fe2a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:08:32.627571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:32.670886 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:32.714775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:32.719297 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] Deleted volume successfully. Nov 10 04:08:32.738001 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0d55a16b-f791-4c42-bffb-e20b0e7220a7 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-c41b9c83-4795-4424-b391-4f7b0d7c533f-delete_volume'" released by "delete_volume" :: held 0.580s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:08:33.325903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-9a0d099e-a73e-44e8-8262-6ad489bf17e6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:08:33.363261 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:33.408428 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:08:33.408892 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:08:33.413756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] deleting rbd volume volume-9a0d099e-a73e-44e8-8262-6ad489bf17e6 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:08:33.638606 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] Created reservations ['cc87fb21-85ad-475b-a3e4-fa245f9f656a', '2b64a361-fe05-4ecd-896a-a50ea4f8d237', 'd1cc6902-860f-4bca-9c9d-eafd0b612055', '0f633159-5ffd-4c01-bdf0-568da5ae0103'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:08:33.685743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:33.731342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:33.761829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:33.766410 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] Deleted volume successfully. Nov 10 04:08:33.784117 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-c629130c-841c-4c8c-ad63-9a6a7528d212 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-9a0d099e-a73e-44e8-8262-6ad489bf17e6-delete_volume'" released by "delete_volume" :: held 0.458s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:08:34.148878 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-dcc913a8-9f2e-46ec-b4b2-85431a7d7cca req-c05404f4-3485-4e06-9666-d2df16143506 tempest-AttachVolumeNegativeTest-659951714 None] Terminate volume connection completed successfully. Nov 10 04:08:34.149439 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-dcc913a8-9f2e-46ec-b4b2-85431a7d7cca req-c05404f4-3485-4e06-9666-d2df16143506 tempest-AttachVolumeNegativeTest-659951714 None] Deleting attachment af51c555-2650-4a70-9b1f-7985c2553fd5. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:08:34.476881 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-d9503646-2c1b-46f1-9bbe-418ef20ac849-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:08:34.515597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:34.554123 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:08:34.554514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] volume has clone snapshot(s) {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1207}} Nov 10 04:08:34.556083 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:08:34.686229 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] Created reservations ['72f6b3e2-1d3a-4451-9f2c-3df3bd6e60bf', '718791c0-9bc3-4a4a-aba6-a16a3071c70b', 'eec6c9b4-c9e4-4730-bbc1-65bf259777f2', 'ed299d84-82ec-4d3b-990a-94f42fb5e1c3'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:08:34.746619 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:34.809545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:34.872148 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:34.890065 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] Deleted volume successfully. Nov 10 04:08:34.907527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] Lock "b'cinder-d297f4e1-6b88-4c30-a5c4-dbd4648142fe-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:08:34.950614 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-fae177cd-19a4-4318-9b4a-90d3e380e920 tempest-TaggedBootDevicesTest-2048337972 None] Lock "b'cinder-d9503646-2c1b-46f1-9bbe-418ef20ac849-delete_volume'" released by "delete_volume" :: held 0.474s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:08:34.953321 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:35.007233 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:08:35.007647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] Volume volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:08:35.012500 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] deleting rbd volume volume-d297f4e1-6b88-4c30-a5c4-dbd4648142fe {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:08:35.235183 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] Created reservations ['d81b48c7-b01c-4cdc-b6cc-e11e234d5beb', 'd433b1e9-3733-4ef9-889c-6ffb6289db0a', '6d378454-fa43-4235-9f40-90d0a842f281', 'ab1ca3a1-21d1-40aa-9dec-863fb196c390'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:08:35.286953 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:35.322400 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:35.364643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:35.374972 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] Deleted volume successfully. Nov 10 04:08:35.396527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f9bbcdf1-0bbc-40bf-b9a5-4ec81c567d41 tempest-AttachVolumeNegativeTest-659951714 None] Lock "b'cinder-d297f4e1-6b88-4c30-a5c4-dbd4648142fe-delete_volume'" released by "delete_volume" :: held 0.489s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:08:40.267398 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] Lock "b'cinder-ac8dcbd3-f970-4a5c-ac93-c5054527e78b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:08:40.308665 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:40.392457 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:08:40.393006 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] Volume volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:08:40.401016 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] deleting rbd volume volume-ac8dcbd3-f970-4a5c-ac93-c5054527e78b {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:08:40.753439 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] Created reservations ['2b2ee603-0f77-429f-b6bb-b03f910fd4c3', '6103d931-96fa-4c65-82c9-8a377e03b62d', 'd90340c7-efc8-4a28-b1ed-15580f7227b8', 'cf7e7fe2-41e1-46b3-b009-4227e201ae14'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:08:40.810729 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:40.877530 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:40.967836 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:40.973493 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] Deleted volume successfully. Nov 10 04:08:40.990840 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-925dbf5f-ba87-43df-a9ce-7d8de6e6ccd4 tempest-AttachVolumeNegativeTest-659951714 None] Lock "b'cinder-ac8dcbd3-f970-4a5c-ac93-c5054527e78b-delete_volume'" released by "delete_volume" :: held 0.723s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:08:50.118601 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] Lock "b'cinder-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:08:50.198929 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:50.302552 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:08:50.302975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] Volume volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:08:50.317547 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] deleting rbd volume volume-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:08:50.701293 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] Created reservations ['cbcd2d16-2b0a-47a8-9d40-31527da9326a', '08b202e0-5300-4992-a21a-8fbe7699abdc', 'b594a483-4a49-4589-813c-d4f2c8027aed', '8b3a70ea-904c-4d39-bcd1-c58746e30da7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:08:50.770153 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:50.846624 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:50.900766 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:08:50.908585 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] Deleted volume successfully. Nov 10 04:08:50.944034 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2f740181-29c0-42e6-893e-91a173281597 tempest-AttachVolumeNegativeTest-659951714 None] Lock "b'cinder-1b43c02e-2da9-4fd7-9ff3-ea2417db5d85-delete_volume'" released by "delete_volume" :: held 0.825s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:08:58.767251 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:08:58.772982 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:08:58.774803 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:08:58.793880 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Flow 'volume_create_manager' (88a0cc7a-ac8b-457e-b044-584ef7857266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:08:58.798232 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54398c47-4df1-47e9-9768-c38e5b9d509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:58.806403 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:08:58.827455 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54398c47-4df1-47e9-9768-c38e5b9d509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1600058575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1aaa3380-8dee-4f17-adcc-0d48da11b2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271f00a4ad02402fbd7b8f766261d599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:08:59Z,use_quota=True,user_id='14e59f66385f4e5090ea04544ec6d3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:58.830532 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18659e5e-66b4-4d4a-9fae-2f10321db86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:58.833299 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18659e5e-66b4-4d4a-9fae-2f10321db86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:58.837091 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfd666-086c-4ecf-a014-304632a22781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:58.839680 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfd666-086c-4ecf-a014-304632a22781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aaa3380-8dee-4f17-adcc-0d48da11b2ab', 'volume_name': 'volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:58.842421 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27323afd-ddd5-43c1-ac46-f699dc97b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:58.844925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27323afd-ddd5-43c1-ac46-f699dc97b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:58.848491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3391588-58be-41f8-9268-9aef96f2c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:58.850460 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Volume 1aaa3380-8dee-4f17-adcc-0d48da11b2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab', 'volume_size': 1} Nov 10 04:08:58.851070 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] creating volume 'volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:08:58.854092 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:08:59.005535 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:08:59.006200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:08:59.011455 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3391588-58be-41f8-9268-9aef96f2c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:59.014390 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5db4fb-1535-4551-8d17-2ec4d54571bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:08:59.043553 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Volume volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab (1aaa3380-8dee-4f17-adcc-0d48da11b2ab): created successfully Nov 10 04:08:59.046226 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5db4fb-1535-4551-8d17-2ec4d54571bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:08:59.056195 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Flow 'volume_create_manager' (88a0cc7a-ac8b-457e-b044-584ef7857266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:08:59.076924 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-bba377ab-4e15-4e61-ab87-bebdb8db181f req-0e8a53c4-83c1-41a6-b284-fb241024d616 tempest-VolumesSnapshotsTestJSON-1415022290 None] Created volume successfully. Nov 10 04:09:00.747921 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-f6c2e7c1-8007-4692-bbe6-243a7171020d req-2b91797c-1a01-47f3-8967-0729ef0042f4 tempest-VolumesSnapshotsTestJSON-1415022290 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:01.897953 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-f6c2e7c1-8007-4692-bbe6-243a7171020d req-2b91797c-1a01-47f3-8967-0729ef0042f4 tempest-VolumesSnapshotsTestJSON-1415022290 None] Create snapshot completed successfully Nov 10 04:09:02.206796 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-1d6a116d-5f7d-4e88-b134-964a83bd95fb req-169fc9fc-b002-4854-8d78-5d9f7f9cebdc tempest-VolumesSnapshotsTestJSON-1415022290 None] Lock "b'cinder-a0096bfb-c2d9-41e2-bada-da51d40818dc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:09:02.208205 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1d6a116d-5f7d-4e88-b134-964a83bd95fb req-169fc9fc-b002-4854-8d78-5d9f7f9cebdc tempest-VolumesSnapshotsTestJSON-1415022290 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:02.971396 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-1d6a116d-5f7d-4e88-b134-964a83bd95fb req-169fc9fc-b002-4854-8d78-5d9f7f9cebdc tempest-VolumesSnapshotsTestJSON-1415022290 None] Created reservations ['10c6e26d-725c-4d40-b0f5-97a2b236f4fa', 'c34befcc-5f46-4631-a986-11050c7394e7', '36d2708b-7049-4486-ac37-90bb9e61c233', '0d1f0270-7f33-47e2-902c-d49fac440aeb'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:09:03.059514 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1d6a116d-5f7d-4e88-b134-964a83bd95fb req-169fc9fc-b002-4854-8d78-5d9f7f9cebdc tempest-VolumesSnapshotsTestJSON-1415022290 None] Delete snapshot completed successfully. Nov 10 04:09:03.067568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-1d6a116d-5f7d-4e88-b134-964a83bd95fb req-169fc9fc-b002-4854-8d78-5d9f7f9cebdc tempest-VolumesSnapshotsTestJSON-1415022290 None] Lock "b'cinder-a0096bfb-c2d9-41e2-bada-da51d40818dc-delete_snapshot'" released by "delete_snapshot" :: held 0.861s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:09:03.596516 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] Lock "b'cinder-1aaa3380-8dee-4f17-adcc-0d48da11b2ab-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:09:03.676006 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:03.745703 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:09:03.746091 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] Volume volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:09:03.754140 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] deleting rbd volume volume-1aaa3380-8dee-4f17-adcc-0d48da11b2ab {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:09:04.094150 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] Created reservations ['a180bab6-141b-4695-9ade-3986ca4c7162', '61605cca-26c6-43ce-b1f9-8065517464d8', '73e7f92f-a128-4c3a-b4ab-3b10cae7287b', '667dc4b3-7845-4ae7-a93e-67f100f1c7c1'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:09:04.154482 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:04.218139 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:04.264264 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:09:04.270694 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] Deleted volume successfully. Nov 10 04:09:04.286776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-a0bc4a72-5606-4dc2-9aac-9a554af9e42e req-6e6770f3-b0fd-4de7-ae33-7d1ec98ab73e tempest-VolumesSnapshotsTestJSON-1415022290 None] Lock "b'cinder-1aaa3380-8dee-4f17-adcc-0d48da11b2ab-delete_volume'" released by "delete_volume" :: held 0.690s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:09:12.565232 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-ff8d7133-c6e9-4a6b-b611-169911b96ad6 tempest-ServersTestBootFromVolume-1968196142 None] Terminate volume connection completed successfully. Nov 10 04:09:12.565878 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-ff8d7133-c6e9-4a6b-b611-169911b96ad6 tempest-ServersTestBootFromVolume-1968196142 None] Deleting attachment 1cde655e-6247-4f27-b5e9-2428789a4cdd. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:09:12.790804 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] Lock "b'cinder-88717027-3af9-48fa-b94b-cd4c304810a8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:09:12.864685 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:12.997628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:09:13.015865 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] deleting rbd volume volume-88717027-3af9-48fa-b94b-cd4c304810a8 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:09:13.540279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:09:13.586143 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] deleting parent snapshot volume-88717027-3af9-48fa-b94b-cd4c304810a8.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:09:14.623362 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] Created reservations ['37e382ee-1d9a-493a-ad27-efb7d86396da', '84b49497-3bda-47dc-b681-06e4cc94134f', '9697488f-8a27-4c0e-8435-b4c623313da8', 'c505f574-a5c0-46ca-bc09-2e009ec6ef3f'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:09:14.713588 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:14.785648 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:14.865057 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:09:14.870924 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] Deleted volume successfully. Nov 10 04:09:14.894097 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-6cc3ac59-63a1-48c5-a1ac-cfd89d7e0a2a req-81271ad4-43c3-4947-ad1d-50ac4cb9c286 tempest-ServersTestBootFromVolume-1968196142 None] Lock "b'cinder-88717027-3af9-48fa-b94b-cd4c304810a8-delete_volume'" released by "delete_volume" :: held 2.103s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:09:28.545600 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:09:28.547968 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:28.651049 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:09:28.720582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:10:16.311429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] Lock "b'cinder-ca044ea8-3bef-4b37-8b7c-68a868d66847-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:10:16.353216 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:10:16.432018 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:10:16.432443 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] Volume volume-ca044ea8-3bef-4b37-8b7c-68a868d66847 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:10:16.439340 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] deleting rbd volume volume-ca044ea8-3bef-4b37-8b7c-68a868d66847 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:10:16.798975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] Created reservations ['965ea64e-3141-4549-be0e-81c3afc212e6', '1285f68e-43e3-49e9-ae2d-a4e1052e895d', '0ebaca77-b3bd-4199-bd0f-75663b48fd31', '179c8270-d6b0-4c46-b4d8-0e8391ab8d5e'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:10:16.877318 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:10:16.961683 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:10:17.015134 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:10:17.019943 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] Deleted volume successfully. Nov 10 04:10:17.034836 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-aea267b6-84bb-4afd-a8b8-76497840aa0d tempest-DeleteServersTestJSON-1714889781 None] Lock "b'cinder-ca044ea8-3bef-4b37-8b7c-68a868d66847-delete_volume'" released by "delete_volume" :: held 0.724s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:10:28.544291 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:10:28.546915 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:10:28.620570 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:10:28.652265 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:02.435428 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:02.440774 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:02.443843 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:02.465468 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Flow 'volume_create_manager' (da44dc9c-421b-40ca-81ac-a72b744fd507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:02.468925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0a8a2f-78ec-4fa2-9ac7-1771b4dc3799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:02.477533 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:02.493397 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0a8a2f-78ec-4fa2-9ac7-1771b4dc3799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2036050013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=4a50b61b-b89e-43ca-8074-66963dddf022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aac63e33be04ef8abfa5c1d42df2502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:02Z,use_quota=True,user_id='f386ffa5999e4ef593908fda06e3b684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:02.496308 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2ac60f-451a-4441-bc8a-9b7e95790b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:02.498882 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2ac60f-451a-4441-bc8a-9b7e95790b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:02.501428 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfd9ef7-c62d-4436-8aff-a96cb008e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:02.504627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfd9ef7-c62d-4436-8aff-a96cb008e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a50b61b-b89e-43ca-8074-66963dddf022', 'volume_name': 'volume-4a50b61b-b89e-43ca-8074-66963dddf022', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:02.507219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91db3c3-f65d-4fb7-afc9-aef413684881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:02.509602 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91db3c3-f65d-4fb7-afc9-aef413684881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:02.512286 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce128a7d-4a3a-4d7b-b32f-afc981fa5fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:02.513173 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Volume 4a50b61b-b89e-43ca-8074-66963dddf022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a50b61b-b89e-43ca-8074-66963dddf022', 'volume_size': 1} Nov 10 04:11:02.514473 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] creating volume 'volume-4a50b61b-b89e-43ca-8074-66963dddf022' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:02.515900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:02.616378 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:02.616794 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:02.618834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce128a7d-4a3a-4d7b-b32f-afc981fa5fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a50b61b-b89e-43ca-8074-66963dddf022', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:02.621003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88739842-539a-4e23-99cd-d7470709cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:02.632135 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Volume volume-4a50b61b-b89e-43ca-8074-66963dddf022 (4a50b61b-b89e-43ca-8074-66963dddf022): created successfully Nov 10 04:11:02.634370 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88739842-539a-4e23-99cd-d7470709cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:02.639793 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Flow 'volume_create_manager' (da44dc9c-421b-40ca-81ac-a72b744fd507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:02.650444 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3747b4ba-5b5e-42c4-aac4-36ac8e595331 tempest-SnapshotsActionsTest-323559793 None] Created volume successfully. Nov 10 04:11:03.615794 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-30c40bc7-87d3-43ca-be82-6e34898cef44 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:04.588699 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-30c40bc7-87d3-43ca-be82-6e34898cef44 tempest-SnapshotsActionsTest-323559793 None] Create snapshot completed successfully Nov 10 04:11:05.280280 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03babf66-dba2-4540-b9af-46084157d821 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:05.576132 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-03babf66-dba2-4540-b9af-46084157d821 tempest-SnapshotsActionsTest-323559793 None] Create snapshot completed successfully Nov 10 04:11:06.449776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-576d3c99-e24f-4f30-b8ca-8d86b3c18792 tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-4f0893d4-b5c5-4248-96f1-b514b88ab5db-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:06.456237 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-576d3c99-e24f-4f30-b8ca-8d86b3c18792 tempest-SnapshotsActionsTest-1773394392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:07.602674 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-576d3c99-e24f-4f30-b8ca-8d86b3c18792 tempest-SnapshotsActionsTest-1773394392 None] Created reservations ['e49a1045-daf9-4b85-a2a4-a0f5a30fc1bb', 'be61473b-421b-4e25-a309-652b6b9c4916', '1e63ac26-e9c8-430c-a7e3-e7c91ebed406', '3f5345e0-41e7-4e9b-9ee2-e1482563a3f2'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:07.663922 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-576d3c99-e24f-4f30-b8ca-8d86b3c18792 tempest-SnapshotsActionsTest-1773394392 None] Delete snapshot completed successfully. Nov 10 04:11:07.680946 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-576d3c99-e24f-4f30-b8ca-8d86b3c18792 tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-4f0893d4-b5c5-4248-96f1-b514b88ab5db-delete_snapshot'" released by "delete_snapshot" :: held 1.220s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:08.815615 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e68eb6dd-d863-435f-abb8-c3bf26d00018 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:09.655492 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e68eb6dd-d863-435f-abb8-c3bf26d00018 tempest-SnapshotsActionsTest-323559793 None] Create snapshot completed successfully Nov 10 04:11:09.947776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-989af637-218a-4ea3-a3dc-9d1065ebbc60 tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-c8552c92-489f-4876-8cb3-056e320d7377-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:09.949251 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-989af637-218a-4ea3-a3dc-9d1065ebbc60 tempest-SnapshotsActionsTest-1773394392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:10.667962 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-989af637-218a-4ea3-a3dc-9d1065ebbc60 tempest-SnapshotsActionsTest-1773394392 None] Created reservations ['91a1ee1a-a953-4cd4-839b-7d3b2a8f68d8', '8f70627e-9773-40a0-9140-bb2a2a2fa8dd', 'f998029a-bad1-43bb-9db9-d5f03eefbb43', 'c392e1b5-4330-4558-9196-5fca2113eeb7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:10.719605 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-989af637-218a-4ea3-a3dc-9d1065ebbc60 tempest-SnapshotsActionsTest-1773394392 None] Delete snapshot completed successfully. Nov 10 04:11:10.725936 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-989af637-218a-4ea3-a3dc-9d1065ebbc60 tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-c8552c92-489f-4876-8cb3-056e320d7377-delete_snapshot'" released by "delete_snapshot" :: held 0.778s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:11.217456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8991e4a9-c66d-47fa-bb98-5006c09eda70 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:12.007500 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8991e4a9-c66d-47fa-bb98-5006c09eda70 tempest-SnapshotsActionsTest-323559793 None] Create snapshot completed successfully Nov 10 04:11:12.353698 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9d51d0cb-8587-46b0-909f-5f65ef7d05dd tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-168b0dac-89f2-4871-8918-b62857dcc5b3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:12.355093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d51d0cb-8587-46b0-909f-5f65ef7d05dd tempest-SnapshotsActionsTest-1773394392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:13.053276 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-9d51d0cb-8587-46b0-909f-5f65ef7d05dd tempest-SnapshotsActionsTest-1773394392 None] Created reservations ['01a70d3e-6537-4b64-b24d-d9eec9b130d3', '8c7eb465-1aa5-4c05-96e2-210695c21f11', 'fe604332-0baf-4ca2-9269-940a45689773', '76a6cf6b-1418-45ef-b57b-14dea5e06fac'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:13.095834 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9d51d0cb-8587-46b0-909f-5f65ef7d05dd tempest-SnapshotsActionsTest-1773394392 None] Delete snapshot completed successfully. Nov 10 04:11:13.101791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9d51d0cb-8587-46b0-909f-5f65ef7d05dd tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-168b0dac-89f2-4871-8918-b62857dcc5b3-delete_snapshot'" released by "delete_snapshot" :: held 0.748s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:13.641014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0447af2a-c640-40f3-bbbc-1c030e93b59b tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:14.033919 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0447af2a-c640-40f3-bbbc-1c030e93b59b tempest-SnapshotsActionsTest-323559793 None] Create snapshot completed successfully Nov 10 04:11:14.802508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3535d0d6-6e0f-4c3e-b79b-12493cfd9587 tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-fe2a4008-7589-4dab-ad9c-e380cdbf1dbc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:14.804733 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3535d0d6-6e0f-4c3e-b79b-12493cfd9587 tempest-SnapshotsActionsTest-1773394392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:16.002082 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3535d0d6-6e0f-4c3e-b79b-12493cfd9587 tempest-SnapshotsActionsTest-1773394392 None] Created reservations ['773e65a5-4a10-4077-82c8-01b0d9d13484', '8586600e-8092-493b-8a8c-ec47c2870332', '08d95986-b07e-4762-8f02-635b5d79876f', '53ca99ce-b7bf-40be-9f2d-807a3cd0c95b'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:16.033245 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3535d0d6-6e0f-4c3e-b79b-12493cfd9587 tempest-SnapshotsActionsTest-1773394392 None] Delete snapshot completed successfully. Nov 10 04:11:16.038365 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3535d0d6-6e0f-4c3e-b79b-12493cfd9587 tempest-SnapshotsActionsTest-1773394392 None] Lock "b'cinder-fe2a4008-7589-4dab-ad9c-e380cdbf1dbc-delete_snapshot'" released by "delete_snapshot" :: held 1.236s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:17.278024 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1229d6fc-c29d-4f23-adfa-be08638f4523 tempest-SnapshotsActionsTest-323559793 None] Lock "b'cinder-d401e352-d163-45e1-93af-851ef021bf42-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:17.279912 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1229d6fc-c29d-4f23-adfa-be08638f4523 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:18.022542 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-1229d6fc-c29d-4f23-adfa-be08638f4523 tempest-SnapshotsActionsTest-323559793 None] Created reservations ['a9ee57ed-60e3-4998-ad79-478bf72df7be', '8076b886-ece9-44ef-8556-9c32f560bbff', '6551671f-7b29-49c0-ba35-2ee6ebac1173', 'b400b99b-5a60-4c67-9d03-0da6a5235641'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:18.057226 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1229d6fc-c29d-4f23-adfa-be08638f4523 tempest-SnapshotsActionsTest-323559793 None] Delete snapshot completed successfully. Nov 10 04:11:18.062204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1229d6fc-c29d-4f23-adfa-be08638f4523 tempest-SnapshotsActionsTest-323559793 None] Lock "b'cinder-d401e352-d163-45e1-93af-851ef021bf42-delete_snapshot'" released by "delete_snapshot" :: held 0.784s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:18.373972 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] Lock "b'cinder-4a50b61b-b89e-43ca-8074-66963dddf022-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:18.405750 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:18.445603 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:18.446688 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] Volume volume-4a50b61b-b89e-43ca-8074-66963dddf022 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:18.457984 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] deleting rbd volume volume-4a50b61b-b89e-43ca-8074-66963dddf022 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:18.746428 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] Created reservations ['51420e8b-c93a-400b-a493-7f47bc3b5b1d', '07bee25e-92ff-4e47-9ff3-312a19248f12', '81b82fcc-e936-49e3-86f3-0ea3645a86ab', 'd62d09cc-98bd-4d2e-8a88-6ac1d4558748'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:18.817919 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:18.876182 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:18.926001 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:18.931192 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] Deleted volume successfully. Nov 10 04:11:18.946844 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e8a6ffc0-c935-48d3-aa13-e6f34a09b7d4 tempest-SnapshotsActionsTest-323559793 None] Lock "b'cinder-4a50b61b-b89e-43ca-8074-66963dddf022-delete_volume'" released by "delete_volume" :: held 0.573s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:27.093759 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:27.096985 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:27.097444 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:27.109525 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Flow 'volume_create_manager' (56ea30fa-9089-4183-b926-b2c3bf7fc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:27.112522 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2e4ef5-bb32-448f-95fc-b83dd94314c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:27.120856 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:27.134407 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2e4ef5-bb32-448f-95fc-b83dd94314c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1648436188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ed657b9d-020b-4db0-aa06-9855ff2106a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d111073119c42b0b6837eaa3e2e210c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:27Z,use_quota=True,user_id='14f04017c3714c78be8ccb5cecaf7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:27.136886 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0c81a9-b21e-4850-8a6e-44cdf9b5f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:27.139167 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0c81a9-b21e-4850-8a6e-44cdf9b5f417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:27.141769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579c1398-c727-4016-b9ea-f9d056405bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:27.145180 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579c1398-c727-4016-b9ea-f9d056405bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed657b9d-020b-4db0-aa06-9855ff2106a3', 'volume_name': 'volume-ed657b9d-020b-4db0-aa06-9855ff2106a3', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:27.147509 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c64795a-85b6-4edc-b9ec-f54cced5c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:27.149741 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c64795a-85b6-4edc-b9ec-f54cced5c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:27.151982 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8169c921-2d5a-41d8-a37d-c60430e7832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:27.152966 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Volume ed657b9d-020b-4db0-aa06-9855ff2106a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed657b9d-020b-4db0-aa06-9855ff2106a3', 'volume_size': 1} Nov 10 04:11:27.153361 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] creating volume 'volume-ed657b9d-020b-4db0-aa06-9855ff2106a3' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:27.154335 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:27.216455 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:27.216831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:27.218784 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8169c921-2d5a-41d8-a37d-c60430e7832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed657b9d-020b-4db0-aa06-9855ff2106a3', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:27.221211 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cbccc2-7e03-4972-af55-8be469cb4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:27.230361 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Volume volume-ed657b9d-020b-4db0-aa06-9855ff2106a3 (ed657b9d-020b-4db0-aa06-9855ff2106a3): created successfully Nov 10 04:11:27.232584 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cbccc2-7e03-4972-af55-8be469cb4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:27.235542 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Flow 'volume_create_manager' (56ea30fa-9089-4183-b926-b2c3bf7fc176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:27.247849 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2aad714e-b08d-43f2-a555-c3ebdc9a512c tempest-VolumesListAdminTestJSON-160635079 None] Created volume successfully. Nov 10 04:11:28.439786 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:28.443155 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:28.443717 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:28.456299 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Flow 'volume_create_manager' (870d1542-b9b0-4c39-833d-e3c8ba22ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:28.459491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f0c7b0-6f08-4e72-a408-28c7fde4641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:28.465956 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:28.479746 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f0c7b0-6f08-4e72-a408-28c7fde4641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2085524538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=80960587-361d-4401-acbe-242c81a2eb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d111073119c42b0b6837eaa3e2e210c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:28Z,use_quota=True,user_id='14f04017c3714c78be8ccb5cecaf7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:28.482384 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661d69d8-e248-49ac-bc16-0ad0caa0a53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:28.484450 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661d69d8-e248-49ac-bc16-0ad0caa0a53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:28.486779 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4d0525-4b68-4c0d-b867-b888a57c9cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:28.489621 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4d0525-4b68-4c0d-b867-b888a57c9cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80960587-361d-4401-acbe-242c81a2eb59', 'volume_name': 'volume-80960587-361d-4401-acbe-242c81a2eb59', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:28.492646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4732716-e3b5-4394-befa-c6928d649557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:28.494107 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4732716-e3b5-4394-befa-c6928d649557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:28.496234 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0735adc6-47a3-417c-9944-509df4372e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:28.497015 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Volume 80960587-361d-4401-acbe-242c81a2eb59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80960587-361d-4401-acbe-242c81a2eb59', 'volume_size': 1} Nov 10 04:11:28.497415 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] creating volume 'volume-80960587-361d-4401-acbe-242c81a2eb59' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:28.498391 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:28.547284 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:11:28.548891 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:28.583317 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:28.614446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:28.625756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:28.626134 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:28.628389 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0735adc6-47a3-417c-9944-509df4372e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80960587-361d-4401-acbe-242c81a2eb59', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:28.630708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9d829d-7284-42ce-a12d-cd3b3a32ba6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:28.640367 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Volume volume-80960587-361d-4401-acbe-242c81a2eb59 (80960587-361d-4401-acbe-242c81a2eb59): created successfully Nov 10 04:11:28.642549 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9d829d-7284-42ce-a12d-cd3b3a32ba6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:28.646703 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Flow 'volume_create_manager' (870d1542-b9b0-4c39-833d-e3c8ba22ea52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:28.654882 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4bea4170-2791-41a5-85d4-abd519d60b58 tempest-VolumesListAdminTestJSON-160635079 None] Created volume successfully. Nov 10 04:11:29.785484 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:29.789501 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:29.791071 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:29.803957 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Flow 'volume_create_manager' (177a2ffb-6f86-47cf-8612-b88eb0ea0240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:29.807124 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8597c82b-484f-4f20-a698-b928fb4dba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:29.814736 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:29.835090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8597c82b-484f-4f20-a698-b928fb4dba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-542364414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=2632cbd6-e52f-4da2-ab66-29589ffd8a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d111073119c42b0b6837eaa3e2e210c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:30Z,use_quota=True,user_id='14f04017c3714c78be8ccb5cecaf7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:29.837872 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab636755-3cd0-4371-9e65-917761dcaf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:29.840032 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab636755-3cd0-4371-9e65-917761dcaf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:29.842514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29098862-c6af-4182-b917-4c61e5522aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:29.844952 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29098862-c6af-4182-b917-4c61e5522aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2632cbd6-e52f-4da2-ab66-29589ffd8a4e', 'volume_name': 'volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:29.847783 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35abd85c-4b23-4a2b-b4ff-394f4a07193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:29.849909 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35abd85c-4b23-4a2b-b4ff-394f4a07193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:29.852144 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724db18e-c3f9-44b0-9eee-845acc3905af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:29.852894 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Volume 2632cbd6-e52f-4da2-ab66-29589ffd8a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e', 'volume_size': 1} Nov 10 04:11:29.853291 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] creating volume 'volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:29.854283 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:29.908225 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:29.908585 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:29.911471 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724db18e-c3f9-44b0-9eee-845acc3905af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:29.913758 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd5d67-66f8-4c3c-921b-4a86233109ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:29.922211 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Volume volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e (2632cbd6-e52f-4da2-ab66-29589ffd8a4e): created successfully Nov 10 04:11:29.924120 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd5d67-66f8-4c3c-921b-4a86233109ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:29.927570 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Flow 'volume_create_manager' (177a2ffb-6f86-47cf-8612-b88eb0ea0240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:29.935803 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f0d68180-6ceb-4359-af5c-62cb51a76c6e tempest-VolumesListAdminTestJSON-160635079 None] Created volume successfully. Nov 10 04:11:31.396802 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:31.401949 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:31.403916 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:31.417358 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Flow 'volume_create_manager' (003cdb84-2d88-45ca-8c47-4feb57f0008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:31.420462 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c947b2-f3cf-4cc7-a0fc-9cb2b82eab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:31.427507 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:31.441698 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c947b2-f3cf-4cc7-a0fc-9cb2b82eab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=7f63e058-3223-4eec-ac14-0c7547dd7653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4ad68483d54bf0950b264b58c21ff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:31Z,use_quota=True,user_id='ccc1488151ed481b982cf431f92aa0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:31.444305 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5012ebee-87e1-49f3-8a2f-70cfa8642114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:31.446433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5012ebee-87e1-49f3-8a2f-70cfa8642114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:31.448753 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a58d77b-eed5-4546-8a6c-5f25c6353aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:31.451186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a58d77b-eed5-4546-8a6c-5f25c6353aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f63e058-3223-4eec-ac14-0c7547dd7653', 'volume_name': 'volume-7f63e058-3223-4eec-ac14-0c7547dd7653', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:31.453553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70ccf0f-d9ea-430b-a1dd-cdd3357384c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:31.455761 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70ccf0f-d9ea-430b-a1dd-cdd3357384c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:31.457944 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3fbf83-9e70-4c27-8996-781cb34dfb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:31.458707 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Volume 7f63e058-3223-4eec-ac14-0c7547dd7653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f63e058-3223-4eec-ac14-0c7547dd7653', 'volume_size': 1} Nov 10 04:11:31.459126 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] creating volume 'volume-7f63e058-3223-4eec-ac14-0c7547dd7653' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:31.460092 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:31.565680 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:31.573475 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:31.576380 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3fbf83-9e70-4c27-8996-781cb34dfb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f63e058-3223-4eec-ac14-0c7547dd7653', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:31.581778 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a3b074-9762-415c-8bf7-63ef9d20f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:31.609900 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Volume volume-7f63e058-3223-4eec-ac14-0c7547dd7653 (7f63e058-3223-4eec-ac14-0c7547dd7653): created successfully Nov 10 04:11:31.614487 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a3b074-9762-415c-8bf7-63ef9d20f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:31.619551 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Flow 'volume_create_manager' (003cdb84-2d88-45ca-8c47-4feb57f0008b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:31.630630 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-c3091c1d-d374-4e0e-8893-790a6fa664f8 tempest-VolumesListAdminTestJSON-1788002143 None] Created volume successfully. Nov 10 04:11:32.474653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] Lock "b'cinder-7f63e058-3223-4eec-ac14-0c7547dd7653-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:32.500956 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:32.564803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:32.564803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] Volume volume-7f63e058-3223-4eec-ac14-0c7547dd7653 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:32.570514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] deleting rbd volume volume-7f63e058-3223-4eec-ac14-0c7547dd7653 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:32.596830 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] Lock "b'cinder-2632cbd6-e52f-4da2-ab66-29589ffd8a4e-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:32.667064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:32.744980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:32.745456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] Volume volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:32.771093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] deleting rbd volume volume-2632cbd6-e52f-4da2-ab66-29589ffd8a4e {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:33.172539 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] Created reservations ['c583a480-44f9-4f72-b77c-b7af5d8ae18f', '4de6ef49-c98a-445e-a8c9-cba203c1d2ca', '51f78542-6020-4b49-8c83-717ce819427e', 'ea52a0ac-910c-47fd-b132-90d2fddb311a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:33.256100 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:33.296546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:33.342922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:33.357615 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] Deleted volume successfully. Nov 10 04:11:33.370208 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] Created reservations ['3dd06082-8e1f-4b02-a492-79973d043710', '829c17af-b199-4c02-ab61-59218a36c9f0', 'cdea539c-27c4-4559-852a-13d5c54d340b', '755cc64d-f737-435b-bd2f-d511694a234a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:33.375703 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-64f1f536-4342-4bd2-b8f7-b469865e6512 tempest-VolumesListAdminTestJSON-1788002143 None] Lock "b'cinder-7f63e058-3223-4eec-ac14-0c7547dd7653-delete_volume'" released by "delete_volume" :: held 0.901s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:33.416478 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:33.457553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:33.496900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:33.505201 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] Deleted volume successfully. Nov 10 04:11:33.520316 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-37d64d83-94c3-4a8b-87e3-dc00c8733362 tempest-VolumesListAdminTestJSON-160635079 None] Lock "b'cinder-2632cbd6-e52f-4da2-ab66-29589ffd8a4e-delete_volume'" released by "delete_volume" :: held 0.924s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:33.650661 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] Lock "b'cinder-80960587-361d-4401-acbe-242c81a2eb59-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:33.691368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:33.732008 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:33.732432 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] Volume volume-80960587-361d-4401-acbe-242c81a2eb59 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:33.737516 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] deleting rbd volume volume-80960587-361d-4401-acbe-242c81a2eb59 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:33.971858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] Created reservations ['8ee267a4-8a15-4dc4-87da-f6387d9f063b', 'a4f77305-89bf-4d86-8147-4fde00524f64', '24866739-8221-4b44-b137-fda5c5284892', 'd3c70b82-35fd-4f1e-a6b6-1ea5618109e4'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:34.022630 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:34.057983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:34.104963 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:34.117077 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] Deleted volume successfully. Nov 10 04:11:34.134151 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-60192cc6-02e8-4f75-8b28-94616c554240 tempest-VolumesListAdminTestJSON-160635079 None] Lock "b'cinder-80960587-361d-4401-acbe-242c81a2eb59-delete_volume'" released by "delete_volume" :: held 0.483s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:34.794538 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] Lock "b'cinder-ed657b9d-020b-4db0-aa06-9855ff2106a3-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:34.843549 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:34.892582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:34.893306 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] Volume volume-ed657b9d-020b-4db0-aa06-9855ff2106a3 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:34.904886 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] deleting rbd volume volume-ed657b9d-020b-4db0-aa06-9855ff2106a3 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:35.151851 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] Created reservations ['6132d56b-dfd6-4665-be7b-650cfcd3512f', '389de036-d9ff-4ee4-98b4-1aa7508bdd7f', '0b62e695-a795-4a37-b350-747cbd41b957', '1c0dfc51-27a4-4a17-a633-487f83adb80d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:35.223374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:35.311556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:35.376715 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:35.382100 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] Deleted volume successfully. Nov 10 04:11:35.395715 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-067337e3-6a1c-42b6-b5f6-e5d7acf7fa6c tempest-VolumesListAdminTestJSON-160635079 None] Lock "b'cinder-ed657b9d-020b-4db0-aa06-9855ff2106a3-delete_volume'" released by "delete_volume" :: held 0.602s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:40.548523 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:40.554539 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:40.555228 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:40.570577 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Flow 'volume_create_manager' (50093d13-701c-4e6b-ba06-0d63726f0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:40.575452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59ddb68-89ed-4095-a6d0-9cf3ac10a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:40.586821 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:40.601571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59ddb68-89ed-4095-a6d0-9cf3ac10a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-171147814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=af13b5fa-0090-4c7e-a351-3fb64ab35949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7f372711464978ab97a20f3bbfa870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:40Z,use_quota=True,user_id='f9ea12f76e8644368b2f7d55beed93eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:40.604279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a9d8e2-6a42-41f6-9acd-a213a2c4d95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:40.609123 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a9d8e2-6a42-41f6-9acd-a213a2c4d95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:40.613016 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bced195-9900-4d17-9d16-7b1b685b710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:40.616971 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bced195-9900-4d17-9d16-7b1b685b710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af13b5fa-0090-4c7e-a351-3fb64ab35949', 'volume_name': 'volume-af13b5fa-0090-4c7e-a351-3fb64ab35949', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:40.621133 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dc1fd9-0f5a-44a2-b0e7-ff6656fbfa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:40.625063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dc1fd9-0f5a-44a2-b0e7-ff6656fbfa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:40.627791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0e2939-4370-4e14-b330-cde75f679fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:40.630747 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Volume af13b5fa-0090-4c7e-a351-3fb64ab35949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af13b5fa-0090-4c7e-a351-3fb64ab35949', 'volume_size': 1} Nov 10 04:11:40.631369 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] creating volume 'volume-af13b5fa-0090-4c7e-a351-3fb64ab35949' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:40.633268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:40.772871 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:40.773460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:40.775949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0e2939-4370-4e14-b330-cde75f679fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af13b5fa-0090-4c7e-a351-3fb64ab35949', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:40.779529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858c68d8-1b33-4efc-bdae-70ed51f15a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:40.798788 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Volume volume-af13b5fa-0090-4c7e-a351-3fb64ab35949 (af13b5fa-0090-4c7e-a351-3fb64ab35949): created successfully Nov 10 04:11:40.802574 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858c68d8-1b33-4efc-bdae-70ed51f15a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:40.809772 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Flow 'volume_create_manager' (50093d13-701c-4e6b-ba06-0d63726f0e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:40.827946 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-39862bb8-f0d8-4a14-8989-716d75adf18f tempest-AbsoluteLimitsTests-2068486249 None] Created volume successfully. Nov 10 04:11:41.721339 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] Lock "b'cinder-af13b5fa-0090-4c7e-a351-3fb64ab35949-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:41.782597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:41.857231 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:41.857662 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] Volume volume-af13b5fa-0090-4c7e-a351-3fb64ab35949 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:41.871364 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] deleting rbd volume volume-af13b5fa-0090-4c7e-a351-3fb64ab35949 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:42.216115 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] Created reservations ['96026fd8-2751-40d0-a434-86070eab2769', '6222f1f2-9056-4b39-8ab5-44f39807b30d', 'a59da251-9ed5-4496-9c39-561b44dc16db', '4a46b6c8-a60d-48a6-abab-baf4c11869ee'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:11:42.300177 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:42.381204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:42.452629 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:11:42.469439 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] Deleted volume successfully. Nov 10 04:11:42.499326 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ff336669-af4e-4ba4-9515-70adc1f86cf6 tempest-AbsoluteLimitsTests-2068486249 None] Lock "b'cinder-af13b5fa-0090-4c7e-a351-3fb64ab35949-delete_volume'" released by "delete_volume" :: held 0.778s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:48.813765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:48.818940 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:48.819512 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:48.835205 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (875fbbc3-2ae7-4728-be91-3a480d401a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:48.838525 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f048c2-3172-46fe-b5ee-6ad97bf38967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:48.848721 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:48.862417 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f048c2-3172-46fe-b5ee-6ad97bf38967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1511884471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=76ab6957-1a4e-4472-bcdf-3822448abf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b98bfb2b28b4262b875f96bd53c342b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:49Z,use_quota=True,user_id='a6496c28abe44d83a98e4ce5461b398d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:48.865090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6570e3-737d-4be4-b9c5-3a5e17c0291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:48.867197 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6570e3-737d-4be4-b9c5-3a5e17c0291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:48.871410 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1b6619-0d8e-4174-a3e1-f3360fce2ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:48.980634 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1b6619-0d8e-4174-a3e1-f3360fce2ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76ab6957-1a4e-4472-bcdf-3822448abf81', 'volume_name': 'volume-76ab6957-1a4e-4472-bcdf-3822448abf81', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:48.984374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70342a5b-c7b5-4158-a742-2a2469d55f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:48.987030 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70342a5b-c7b5-4158-a742-2a2469d55f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:48.989650 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32086a3-1bbe-427c-b93d-f6e6a8549065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:48.991215 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Volume 76ab6957-1a4e-4472-bcdf-3822448abf81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76ab6957-1a4e-4472-bcdf-3822448abf81', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:11:48.992033 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Cloning 76ab6957-1a4e-4472-bcdf-3822448abf81 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:11:49.004730 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:49.016909 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 11, 49, 9363)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:11:49.017862 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:11:49.019187 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:11:49.025378 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:11:49.026550 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:11:49.033622 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 11, 49, 30961)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:11:49.034673 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:11:49.035225 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:11:49.053560 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:49.194620 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] creating snapshot='volume-76ab6957-1a4e-4472-bcdf-3822448abf81.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:11:49.537683 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-76ab6957-1a4e-4472-bcdf-3822448abf81.clone_snap' to 'volume-76ab6957-1a4e-4472-bcdf-3822448abf81' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:11:49.778148 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:49.779592 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:49.780172 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:49.824019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:11:49.824784 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Marking volume 76ab6957-1a4e-4472-bcdf-3822448abf81 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:11:49.839514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 76ab6957-1a4e-4472-bcdf-3822448abf81. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:11:49.839998 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Creating volume glance metadata for volume 76ab6957-1a4e-4472-bcdf-3822448abf81 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:11:49.969860 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32086a3-1bbe-427c-b93d-f6e6a8549065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ab6957-1a4e-4472-bcdf-3822448abf81', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:49.976093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3de1cc-c0a0-442b-87fb-0aec77e56cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:50.007559 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Volume volume-76ab6957-1a4e-4472-bcdf-3822448abf81 (76ab6957-1a4e-4472-bcdf-3822448abf81): created successfully Nov 10 04:11:50.016004 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3de1cc-c0a0-442b-87fb-0aec77e56cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:50.025835 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (875fbbc3-2ae7-4728-be91-3a480d401a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:50.048334 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a2a90031-0d7e-454a-b3cd-11e0bc925adc tempest-VolumesCloneTest-1368257245 None] Created volume successfully. Nov 10 04:11:51.975115 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:51.979365 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:51.993345 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:52.072994 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (5c529802-295a-4c27-b8f7-bd3af0430f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:52.078352 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f2ce32-d3dc-473f-b18e-db605a07ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:52.094757 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:52.122553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f2ce32-d3dc-473f-b18e-db605a07ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1759010965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ad0b609f-dc49-49ed-b1ed-c82266f59be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b98bfb2b28b4262b875f96bd53c342b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=76ab6957-1a4e-4472-bcdf-3822448abf81,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:52Z,use_quota=True,user_id='a6496c28abe44d83a98e4ce5461b398d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:52.125076 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b257812f-2f04-44ea-b529-437004d7342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:52.127412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b257812f-2f04-44ea-b529-437004d7342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:52.148448 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58d0f9d-b379-4697-af7a-6d9f863258a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:52.193521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58d0f9d-b379-4697-af7a-6d9f863258a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ad0b609f-dc49-49ed-b1ed-c82266f59be9', 'volume_name': 'volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9', 'volume_size': 1, 'source_volid': '76ab6957-1a4e-4472-bcdf-3822448abf81', 'source_volstatus': 'available'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:52.197042 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafd2d39-7de7-4ce4-87bd-626dbd2ed88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:52.211108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafd2d39-7de7-4ce4-87bd-626dbd2ed88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:52.215692 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30ca1bf-9b9c-4bc6-be6f-c5c04e20f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:52.216519 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Volume ad0b609f-dc49-49ed-b1ed-c82266f59be9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9', 'volume_size': 1, 'source_volid': '76ab6957-1a4e-4472-bcdf-3822448abf81', 'source_volstatus': 'available'} Nov 10 04:11:52.281079 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:52.431108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] creating snapshot='volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:11:52.638436 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] cloning 'volume-76ab6957-1a4e-4472-bcdf-3822448abf81@volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9.clone_snap' to 'volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:11:52.962566 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:52.963647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:52.964024 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:53.004932 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:11:53.006260 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Marking volume ad0b609f-dc49-49ed-b1ed-c82266f59be9 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:11:53.024589 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Copying metadata from source volume 76ab6957-1a4e-4472-bcdf-3822448abf81 to ad0b609f-dc49-49ed-b1ed-c82266f59be9. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:432}} Nov 10 04:11:53.111516 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30ca1bf-9b9c-4bc6-be6f-c5c04e20f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9', 'volume_size': 1, 'source_volid': '76ab6957-1a4e-4472-bcdf-3822448abf81', 'source_volstatus': 'available'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:53.116368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa28982-c51a-4050-89e4-087c78c71b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:53.130569 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Volume volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9 (ad0b609f-dc49-49ed-b1ed-c82266f59be9): created successfully Nov 10 04:11:53.135252 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa28982-c51a-4050-89e4-087c78c71b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:53.139556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (5c529802-295a-4c27-b8f7-bd3af0430f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:53.166698 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2a88a4e2-361d-4319-b432-cd27569234cf tempest-VolumesCloneTest-1368257245 None] Created volume successfully. Nov 10 04:11:54.906877 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:54.912242 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:54.913555 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:54.928901 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (56d819a1-2b52-45d7-bd8c-ec6a09963965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:54.932302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41eb9a26-1e67-4c84-9d9c-dfa6d07a8e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:54.940282 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:54.970857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41eb9a26-1e67-4c84-9d9c-dfa6d07a8e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2057249319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=4a79dec8-e25c-494f-b24c-00a8d8dae4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b98bfb2b28b4262b875f96bd53c342b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:55Z,use_quota=True,user_id='a6496c28abe44d83a98e4ce5461b398d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:54.975152 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8b7223-018d-4f38-8bb7-6ac2af827944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:54.977589 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8b7223-018d-4f38-8bb7-6ac2af827944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:54.980744 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6bc7ef-2087-4ad6-9268-3fbb9e598bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:54.984253 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6bc7ef-2087-4ad6-9268-3fbb9e598bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'volume_name': 'volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:54.986814 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39104993-f05e-4fde-ab3c-1a77b93117e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:54.989935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39104993-f05e-4fde-ab3c-1a77b93117e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:54.993111 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24b0a08-3365-42fe-9213-68fe1cd3b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:54.994125 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Volume 4a79dec8-e25c-494f-b24c-00a8d8dae4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'volume_size': 1} Nov 10 04:11:54.994738 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] creating volume 'volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:11:54.996718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:55.123073 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:55.123393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:55.126151 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24b0a08-3365-42fe-9213-68fe1cd3b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:55.129463 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8afe7a-c3fd-46a3-bd01-4b7dbdf9924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:55.159689 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Volume volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5 (4a79dec8-e25c-494f-b24c-00a8d8dae4c5): created successfully Nov 10 04:11:55.163465 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8afe7a-c3fd-46a3-bd01-4b7dbdf9924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:55.167765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (56d819a1-2b52-45d7-bd8c-ec6a09963965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:55.181043 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8d3b9cf7-5c97-4d02-a654-5b02b00822b6 tempest-VolumesCloneTest-1368257245 None] Created volume successfully. Nov 10 04:11:56.397208 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:11:56.400498 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:11:56.419443 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:11:56.459526 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (ef66311d-1ba1-4bd5-84f5-e101dc3ccdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:56.463196 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981fb708-4994-43f7-8f31-a42dd0c34d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:56.473725 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:11:56.493087 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981fb708-4994-43f7-8f31-a42dd0c34d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-519857918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ba9a5c29-f716-44c3-a8b9-1c08097bfbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b98bfb2b28b4262b875f96bd53c342b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:11:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4a79dec8-e25c-494f-b24c-00a8d8dae4c5,status='creating',terminated_at=None,updated_at=2021-11-10T04:11:56Z,use_quota=True,user_id='a6496c28abe44d83a98e4ce5461b398d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:56.496199 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14758b03-33cb-42dc-8e58-9450abdadcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:56.499451 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14758b03-33cb-42dc-8e58-9450abdadcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:56.503238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7906e7-8caa-426e-8d6a-93c2a87e58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:56.519100 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7906e7-8caa-426e-8d6a-93c2a87e58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ba9a5c29-f716-44c3-a8b9-1c08097bfbd6', 'volume_name': 'volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6', 'volume_size': 2, 'source_volid': '4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'source_volstatus': 'available'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:56.521503 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac7d68-4ac6-4554-8c3e-59c7f9d7cdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:56.523673 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac7d68-4ac6-4554-8c3e-59c7f9d7cdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:56.525872 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc48246f-90a7-4bf4-ad02-f98e3544102a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:56.526894 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Volume ba9a5c29-f716-44c3-a8b9-1c08097bfbd6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6', 'volume_size': 2, 'source_volid': '4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'source_volstatus': 'available'} Nov 10 04:11:56.543653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:56.655654 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] creating snapshot='volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:11:57.054051 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] cloning 'volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5@volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6.clone_snap' to 'volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:11:57.201899 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Volume volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:57.203452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:11:57.204055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:11:57.226603 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] resize volume 'volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6' from 1 to 2 {{(pid=127842) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:693}} Nov 10 04:11:57.227874 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:57.435572 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:11:57.438714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc48246f-90a7-4bf4-ad02-f98e3544102a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6', 'volume_size': 2, 'source_volid': '4a79dec8-e25c-494f-b24c-00a8d8dae4c5', 'source_volstatus': 'available'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:57.442373 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e372d8a-f12a-42df-b0da-88bf4286b2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:11:57.453318 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Volume volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6 (ba9a5c29-f716-44c3-a8b9-1c08097bfbd6): created successfully Nov 10 04:11:57.456783 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e372d8a-f12a-42df-b0da-88bf4286b2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:11:57.460567 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Flow 'volume_create_manager' (ef66311d-1ba1-4bd5-84f5-e101dc3ccdb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:11:57.481331 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b5b3bcf8-4ee1-4d00-abf6-9280a0a83c20 tempest-VolumesCloneTest-1368257245 None] Created volume successfully. Nov 10 04:11:58.701343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:11:58.798267 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:11:58.926126 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:11:58.942810 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] deleting rbd volume volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:11:59.207066 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:11:59.239137 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] Volume volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:11:59.239815 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] deleting parent snapshot volume-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:12:00.230607 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] Created reservations ['87b936d9-ea2c-4b17-b6a2-4c776fdae550', '763e4f60-24c7-4e70-a1b5-10662bbb4903', 'fc4b4e1a-014a-4085-bfc0-618c7b4aeb74', '9ad4e20c-e240-4ef6-a9df-307516de872a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:12:00.313964 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:00.404021 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:00.462283 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:12:00.467029 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] Deleted volume successfully. Nov 10 04:12:00.486747 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-11584bbb-524d-4c53-b3a0-c5628c6bcb79 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-ba9a5c29-f716-44c3-a8b9-1c08097bfbd6-delete_volume'" released by "delete_volume" :: held 1.786s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:12:01.011341 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-4a79dec8-e25c-494f-b24c-00a8d8dae4c5-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:12:01.098818 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:01.222960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:12:01.223501 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] Volume volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:12:01.232037 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] deleting rbd volume volume-4a79dec8-e25c-494f-b24c-00a8d8dae4c5 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:12:01.730738 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] Created reservations ['0713c5c2-7477-459b-9f89-ccc59b9ad82f', '65d6bee6-fe80-4f8e-9be5-f8b95bddc260', '93a4acce-fc33-443c-b4d0-42cf4acbdd86', 'd4b41c91-e441-47b3-804d-798a753c36df'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:12:01.868122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:01.969393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:02.054222 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:12:02.058790 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] Deleted volume successfully. Nov 10 04:12:02.094515 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2a6f06d6-6b55-4906-bd78-7e9ea20c0ef7 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-4a79dec8-e25c-494f-b24c-00a8d8dae4c5-delete_volume'" released by "delete_volume" :: held 1.081s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:12:02.206268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-ad0b609f-dc49-49ed-b1ed-c82266f59be9-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:12:02.249057 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:02.379611 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:12:02.387727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] deleting rbd volume volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:12:02.603702 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:12:02.663501 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] deleting parent snapshot volume-ad0b609f-dc49-49ed-b1ed-c82266f59be9.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:12:03.313727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] Created reservations ['5e833a29-bcf9-4fb1-9ac8-cd9b7b13d957', '78388386-095f-4660-8d68-7eaba145e2ad', '361b2ba3-89dd-466f-bacc-4106daa452ec', '9d639481-ad31-4776-911e-5f3bfceddc6f'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:12:03.406555 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:03.497507 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:03.571972 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:12:03.585144 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] Deleted volume successfully. Nov 10 04:12:03.623334 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e5024f27-0b5c-44e2-bd3d-a2da8c4167d7 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-ad0b609f-dc49-49ed-b1ed-c82266f59be9-delete_volume'" released by "delete_volume" :: held 1.418s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:12:04.562646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-76ab6957-1a4e-4472-bcdf-3822448abf81-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:12:04.652051 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:04.777870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:12:04.798459 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] deleting rbd volume volume-76ab6957-1a4e-4472-bcdf-3822448abf81 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:12:05.259672 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:12:05.311610 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] deleting parent snapshot volume-76ab6957-1a4e-4472-bcdf-3822448abf81.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:12:06.155268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] Created reservations ['bfc7e4a4-16b8-430c-ace0-a0a38fdc3fc0', 'adf3a503-656a-4263-abf2-e8db67849c19', 'c82a30d7-bd11-46b2-aee9-74a4b776239e', '7228d801-85a3-4f90-b77b-14a638da8875'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:12:06.242243 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:06.289162 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:06.373129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:12:06.378820 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] Deleted volume successfully. Nov 10 04:12:06.398140 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1ee2a8f6-081a-4459-a8aa-c2bb8a285352 tempest-VolumesCloneTest-1368257245 None] Lock "b'cinder-76ab6957-1a4e-4472-bcdf-3822448abf81-delete_volume'" released by "delete_volume" :: held 1.836s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:12:12.012788 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:12:12.019726 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:12:12.020188 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:12:12.033977 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (01fb216e-fc40-496c-abf4-8ba18f655e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:12:12.037318 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6593ae-2e8b-4020-b1ad-d71c2c36f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:12.044098 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:12:12.059078 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6593ae-2e8b-4020-b1ad-d71c2c36f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-630467525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=10e45ab1-9a66-45b6-a400-7c909cbde2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b41fe8af644d33915bdae4bbd34947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:12:12Z,use_quota=True,user_id='b14e52c2dee142bb896f6e0e61e52426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:12.062160 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8de305-fdf5-4978-b2ed-0fea69611d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:12.064941 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8de305-fdf5-4978-b2ed-0fea69611d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:12.067552 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60a91f4-97d2-44e7-8cb9-8270bff25876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:12.070346 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60a91f4-97d2-44e7-8cb9-8270bff25876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'volume_name': 'volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:12.072853 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d1956e-b733-4740-b0c5-0178db7f677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:12.075195 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d1956e-b733-4740-b0c5-0178db7f677e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:12.077850 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92af5fb-2a2e-442b-acc3-4147807da106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:12.078731 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Volume 10e45ab1-9a66-45b6-a400-7c909cbde2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'volume_size': 1} Nov 10 04:12:12.079286 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] creating volume 'volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:12:12.081228 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:12.161872 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:12:12.162720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:12:12.165763 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92af5fb-2a2e-442b-acc3-4147807da106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:12.171094 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89c621b-bbad-43ec-b4ab-2b0201f19f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:12.183152 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1 (10e45ab1-9a66-45b6-a400-7c909cbde2b1): created successfully Nov 10 04:12:12.186887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89c621b-bbad-43ec-b4ab-2b0201f19f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:12.191343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (01fb216e-fc40-496c-abf4-8ba18f655e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:12:12.203806 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-168ff35a-e72a-440a-b3ee-d198f099dffd tempest-VolumesSnapshotTestJSON-106401922 None] Created volume successfully. Nov 10 04:12:13.269483 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1884c392-9cd6-446e-b26d-4302a95413fd tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:13.599414 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1884c392-9cd6-446e-b26d-4302a95413fd tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:12:17.484756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.driver [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Creating a new backup for volume volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1. {{(pid=127842) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Nov 10 04:12:17.518854 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] cloning volumes/volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1@snapshot-d13be209-8612-4808-95ed-428e85a1de22 to volume-25d7a4ab-a882-45db-846a-1a02867fed3f {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:12:17.519510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:17.562972 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:17.668421 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:12:17.668837 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:12:17.673154 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:17.709981 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Nov 10 04:12:17.742325 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:12:18.465130 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.722s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:12:18.466390 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-25d7a4ab-a882-45db-846a-1a02867fed3f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '25d7a4ab-a882-45db-846a-1a02867fed3f', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:12:18.494363 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Initialize volume connection completed successfully. Nov 10 04:12:28.544460 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:12:28.545261 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:28.597747 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:28.696287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:12:32.002480 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Terminate volume connection completed successfully. Nov 10 04:12:32.039673 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Remove volume export completed successfully. Nov 10 04:12:32.150003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-25d7a4ab-a882-45db-846a-1a02867fed3f-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:12:32.187014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:32.296942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:12:32.310771 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-25d7a4ab-a882-45db-846a-1a02867fed3f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:12:32.775650 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:12:32.782793 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-d9d748c1-737f-4372-9176-79a061a96aab tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-25d7a4ab-a882-45db-846a-1a02867fed3f-delete_volume'" released by "delete_volume" :: held 0.633s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:12:50.878779 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:12:50.880976 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:12:50.881495 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:12:50.896627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (eca2f9f9-511b-4670-846e-35aac69ceda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:12:50.900237 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ecbd0a-ff63-47da-8cdf-ec2be2a8dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:50.906528 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:12:50.926744 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ecbd0a-ff63-47da-8cdf-ec2be2a8dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-731758789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=cc8f2fc1-7de1-401a-a50f-1d869204c0d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b41fe8af644d33915bdae4bbd34947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:12:51Z,use_quota=True,user_id='b14e52c2dee142bb896f6e0e61e52426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:50.927086 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91fa894-2c60-4cb4-a62e-47ae2272bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:50.927086 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91fa894-2c60-4cb4-a62e-47ae2272bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:50.929427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b949de3a-a3e5-45ef-8f5d-895137e54330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:51.042657 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b949de3a-a3e5-45ef-8f5d-895137e54330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'volume_name': 'volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:51.044993 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffe4f9b-3b50-44ad-bfb4-b06802bd4b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:51.047161 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffe4f9b-3b50-44ad-bfb4-b06802bd4b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:51.050072 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f738ac-1cbd-453e-8b5c-4f9bbfa178c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:51.051100 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Volume cc8f2fc1-7de1-401a-a50f-1d869204c0d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:12:51.051682 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Cloning cc8f2fc1-7de1-401a-a50f-1d869204c0d6 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:12:51.060729 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:12:51.078409 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 12, 51, 65553)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:12:51.078939 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:12:51.080375 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:12:51.084736 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:12:51.085644 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:12:51.091243 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 12, 51, 89042)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:12:51.091653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:12:51.092039 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:12:51.104026 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:51.153263 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] creating snapshot='volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:12:52.082357 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6.clone_snap' to 'volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:12:52.263524 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:12:52.265121 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:12:52.265697 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:12:52.293038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:12:52.294408 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Marking volume cc8f2fc1-7de1-401a-a50f-1d869204c0d6 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:12:52.315068 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to cc8f2fc1-7de1-401a-a50f-1d869204c0d6. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:12:52.315602 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Creating volume glance metadata for volume cc8f2fc1-7de1-401a-a50f-1d869204c0d6 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:12:52.377211 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f738ac-1cbd-453e-8b5c-4f9bbfa178c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:52.378699 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b1aaa1-bd7d-4984-ac30-4551bd4efa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:12:52.388236 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6 (cc8f2fc1-7de1-401a-a50f-1d869204c0d6): created successfully Nov 10 04:12:52.391269 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b1aaa1-bd7d-4984-ac30-4551bd4efa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:12:52.394776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (eca2f9f9-511b-4670-846e-35aac69ceda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:12:52.403801 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9d3936b7-6f1d-4f99-ae01-a6cd5faeb2ef tempest-VolumesSnapshotTestJSON-106401922 None] Created volume successfully. Nov 10 04:12:53.540076 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-0ab00fca-4453-4225-b56f-2b3b461b7cc2 req-fc7f7f4a-9ed4-49cb-8613-9f4257e43bdb tempest-VolumesSnapshotTestJSON-106401922 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:12:54.320702 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-0ab00fca-4453-4225-b56f-2b3b461b7cc2 req-fc7f7f4a-9ed4-49cb-8613-9f4257e43bdb tempest-VolumesSnapshotTestJSON-106401922 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.780s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:12:54.321521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-0ab00fca-4453-4225-b56f-2b3b461b7cc2 req-fc7f7f4a-9ed4-49cb-8613-9f4257e43bdb tempest-VolumesSnapshotTestJSON-106401922 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:12:54.358465 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-0ab00fca-4453-4225-b56f-2b3b461b7cc2 req-fc7f7f4a-9ed4-49cb-8613-9f4257e43bdb tempest-VolumesSnapshotTestJSON-106401922 None] Connection info returned from driver {'name': 'volumes/volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cc8f2fc1-7de1-401a-a50f-1d869204c0d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '034d9cd6-02d5-4121-ba18-95bdf0a86812'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:12:54.411123 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-0ab00fca-4453-4225-b56f-2b3b461b7cc2 req-fc7f7f4a-9ed4-49cb-8613-9f4257e43bdb tempest-VolumesSnapshotTestJSON-106401922 None] attachment_update completed successfully. Nov 10 04:12:57.110699 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bdfa5764-c65a-4f64-b24b-3c34897b28ad tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:12:58.245767 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-bdfa5764-c65a-4f64-b24b-3c34897b28ad tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:12:59.580035 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-720a0c23-1b4c-402d-be87-11d77bc63a7c tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:00.322097 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-720a0c23-1b4c-402d-be87-11d77bc63a7c tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:13:00.950975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e97aa26d-78a3-4a8e-a684-cac9cdb50556 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:02.466464 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e97aa26d-78a3-4a8e-a684-cac9cdb50556 tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:13:03.071292 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5fe21536-2941-4bd6-8131-9a00984a78fd tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-967d8929-cf9e-43c4-9255-4c37a271fd47-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:13:03.077072 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5fe21536-2941-4bd6-8131-9a00984a78fd tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:10.964947 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-4c0080ed-914a-4658-8cc6-6fe8fbf207e6 req-837e3736-1d08-4cd9-b268-31076904f220 tempest-TaggedBootDevicesTest_v242-2045997453 None] Terminate volume connection completed successfully. Nov 10 04:13:10.965678 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-4c0080ed-914a-4658-8cc6-6fe8fbf207e6 req-837e3736-1d08-4cd9-b268-31076904f220 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deleting attachment 30dfaeb8-30f5-4ee8-9c07-fb28bc34ccef. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:13:11.245602 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-4c0080ed-914a-4658-8cc6-6fe8fbf207e6 req-3cde0d50-376a-4007-8c07-6da7835b32b8 tempest-TaggedBootDevicesTest_v242-2045997453 None] Terminate volume connection completed successfully. Nov 10 04:13:11.246781 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-4c0080ed-914a-4658-8cc6-6fe8fbf207e6 req-3cde0d50-376a-4007-8c07-6da7835b32b8 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deleting attachment 5513be6a-bf35-428e-8aa7-180ca23a0196. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:13:11.433061 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-4c0080ed-914a-4658-8cc6-6fe8fbf207e6 req-a9b43aff-b811-4a35-8a35-afb09931b935 tempest-TaggedBootDevicesTest_v242-2045997453 None] Terminate volume connection completed successfully. Nov 10 04:13:11.435200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-4c0080ed-914a-4658-8cc6-6fe8fbf207e6 req-a9b43aff-b811-4a35-8a35-afb09931b935 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deleting attachment 540d930e-43dc-4f45-b1ca-14e3fefd46c6. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:13:20.647954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-023f9c05-65f5-44bd-b072-3c8d6c1feead-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:13:20.731503 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:20.818467 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:13:20.818986 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume volume-023f9c05-65f5-44bd-b072-3c8d6c1feead is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:13:20.836866 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] deleting rbd volume volume-023f9c05-65f5-44bd-b072-3c8d6c1feead {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:13:21.361340 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] Created reservations ['2bea8a6c-c6b5-47b6-a049-c488258398d0', 'f138a8c2-7e51-45c9-bb80-623e53588741', 'ed5d341a-0d03-4db5-b5f5-e7bcfa901a1d', 'eff3c557-27ec-4c9f-aca7-6498d24eddda'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:13:21.451190 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:21.531653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:21.609926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:13:21.614253 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deleted volume successfully. Nov 10 04:13:21.636996 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9fdb7114-afb9-4ca6-b47f-acdcb555c9d2 tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-023f9c05-65f5-44bd-b072-3c8d6c1feead-delete_volume'" released by "delete_volume" :: held 0.989s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:13:21.835026 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-e4fbf22b-09b7-4560-9bef-63f164558bde-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:13:21.878931 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:21.971193 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:13:21.971821 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] Volume volume-e4fbf22b-09b7-4560-9bef-63f164558bde is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:13:21.982569 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] deleting rbd volume volume-e4fbf22b-09b7-4560-9bef-63f164558bde {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:13:22.390946 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] Created reservations ['cae58763-56aa-4a2f-9b1b-7b6fa0d68c98', '4d9eb37d-498c-4801-8f2e-bf0448594050', '1b64434a-0efd-443d-8644-ba1df8ae089a', '9b25f76f-b935-4570-99fe-5866d86d61cc'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:13:22.446487 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:22.495694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:22.528434 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:13:22.543420 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] Deleted volume successfully. Nov 10 04:13:22.558355 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:13:22.561825 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:13:22.562310 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:13:22.574896 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Flow 'volume_create_manager' (7a15db7e-cb46-4100-9c2b-0b555f259a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:13:22.578264 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde66e13-5a40-4f14-881b-b056c5250216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:22.586989 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:13:22.589539 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2b05354f-dd53-4dfd-97fc-d01382c4ba03 tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-e4fbf22b-09b7-4560-9bef-63f164558bde-delete_volume'" released by "delete_volume" :: held 0.755s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:13:22.602969 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde66e13-5a40-4f14-881b-b056c5250216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1395037154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=c7d04806-58b2-4c77-b607-84c48298d9b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c202ba2db2f41bea1c279be7e208461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:13:22Z,use_quota=True,user_id='db12f7ce53e7402b85c932a08e79f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:22.605653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b473ff-cf2b-4f59-83b1-f6fa842fe1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:22.607620 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b473ff-cf2b-4f59-83b1-f6fa842fe1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:22.609986 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9c4c55-896b-4d85-a444-67690987c0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:22.612889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9c4c55-896b-4d85-a444-67690987c0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d04806-58b2-4c77-b607-84c48298d9b6', 'volume_name': 'volume-c7d04806-58b2-4c77-b607-84c48298d9b6', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:22.615135 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c535d6b2-8bb0-45bf-b810-3c47babb3954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:22.617230 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c535d6b2-8bb0-45bf-b810-3c47babb3954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:22.619412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f43c9c-c633-4853-baf4-e1470ba1f27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:22.620197 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Volume c7d04806-58b2-4c77-b607-84c48298d9b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d04806-58b2-4c77-b607-84c48298d9b6', 'volume_size': 1} Nov 10 04:13:22.620598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] creating volume 'volume-c7d04806-58b2-4c77-b607-84c48298d9b6' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:13:22.621636 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:22.703343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:13:22.703749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:13:22.706008 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f43c9c-c633-4853-baf4-e1470ba1f27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d04806-58b2-4c77-b607-84c48298d9b6', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:22.708513 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9972a7-0dc0-424a-af38-a1a9facad617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:22.717973 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Volume volume-c7d04806-58b2-4c77-b607-84c48298d9b6 (c7d04806-58b2-4c77-b607-84c48298d9b6): created successfully Nov 10 04:13:22.722322 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9972a7-0dc0-424a-af38-a1a9facad617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:22.726500 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Flow 'volume_create_manager' (7a15db7e-cb46-4100-9c2b-0b555f259a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:13:22.738485 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a7d9f990-45af-49b3-b437-b508fc2629c0 req-df7231f5-4af3-4170-9738-df2dcd4032d4 tempest-VolumesGetTestJSON-329399135 None] Created volume successfully. Nov 10 04:13:23.031393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-c4fda05b-2142-46a3-bbce-e8f084f23384-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:13:23.088597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:23.189666 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:13:23.198381 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] deleting rbd volume volume-c4fda05b-2142-46a3-bbce-e8f084f23384 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:13:23.825317 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:13:23.883961 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] deleting parent snapshot volume-c4fda05b-2142-46a3-bbce-e8f084f23384.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:13:24.678586 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] Lock "b'cinder-c7d04806-58b2-4c77-b607-84c48298d9b6-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:13:24.752922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] Created reservations ['f329afc2-b7d9-43ed-865d-362e637b67ef', 'bddffe2e-175e-49fc-a18a-64c37d4a8e55', '95a87280-6f7e-4166-a6af-93aaca9fa151', 'e3f44732-4465-4da9-ac76-f0d318765bb7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:13:24.787963 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:24.892788 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:13:24.893223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] Volume volume-c7d04806-58b2-4c77-b607-84c48298d9b6 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:13:24.907491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] deleting rbd volume volume-c7d04806-58b2-4c77-b607-84c48298d9b6 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:13:24.939598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:25.001174 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:25.085960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:13:25.097363 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] Deleted volume successfully. Nov 10 04:13:25.125019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-cad56b73-78a6-44fb-8669-08e86df7df1c tempest-TaggedBootDevicesTest_v242-2045997453 None] Lock "b'cinder-c4fda05b-2142-46a3-bbce-e8f084f23384-delete_volume'" released by "delete_volume" :: held 2.094s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:13:25.449236 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] Created reservations ['8c3f86be-d463-4998-b0e8-a7236d090b0e', '4bf3be7c-0b13-4963-9e58-5ba526068be6', 'f41e2936-9c68-415e-8351-e98e53538b1d', 'fa25fd5e-8d19-4d71-8dd5-dd9f8179b986'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:13:25.511613 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:25.600340 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:25.674966 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:13:25.679619 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] Deleted volume successfully. Nov 10 04:13:25.702754 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-7d9e7d63-7fbd-401c-9c3a-54eda7e886a0 req-9d393894-4063-4357-a5db-ffd918b0954d tempest-VolumesGetTestJSON-329399135 None] Lock "b'cinder-c7d04806-58b2-4c77-b607-84c48298d9b6-delete_volume'" released by "delete_volume" :: held 1.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:13:28.541271 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:13:28.543569 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:28.638594 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:28.710325 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:13:33.439003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-5fe21536-2941-4bd6-8131-9a00984a78fd tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['84106102-82f0-424b-8998-2134149a5ec0', '437cd83c-885f-4c5f-86b1-a3bc7c936d66', '65490d67-cc94-453d-bd7a-33d4b0353858', 'ad95800a-3c87-439d-ad3b-ff5dbb8e76de'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:13:33.547173 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5fe21536-2941-4bd6-8131-9a00984a78fd tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:13:33.555720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5fe21536-2941-4bd6-8131-9a00984a78fd tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-967d8929-cf9e-43c4-9255-4c37a271fd47-delete_snapshot'" released by "delete_snapshot" :: held 30.484s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:13:33.715885 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-fa99a5c5-fd13-4b9b-8cf2-a98d7f07f03f tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-078d8821-6ead-49f3-af00-c4df945fc032-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:13:33.722804 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fa99a5c5-fd13-4b9b-8cf2-a98d7f07f03f tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:57.777475 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:13:57.789044 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:13:57.796672 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:13:57.853864 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Flow 'volume_create_manager' (248bbd31-ba85-441d-a70c-fa3159697609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:13:57.862930 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e95fe9-38ea-4d9c-a83f-1d2fc914b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:57.883793 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:13:57.903051 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e95fe9-38ea-4d9c-a83f-1d2fc914b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-821938009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=45d2c8b9-0863-46bd-a0f0-57df968a6a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16946d4a8d945b6b316d212abca4f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:13:58Z,use_quota=True,user_id='704f4755d3f446429725f2b66cd8a672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:57.906514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e7c2e9-2e13-4c95-8c2c-2114b5d21b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:57.909157 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e7c2e9-2e13-4c95-8c2c-2114b5d21b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:57.911691 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0739dc-7a22-4c2b-8881-6d9211020e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:57.914195 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0739dc-7a22-4c2b-8881-6d9211020e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'volume_name': 'volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:57.917032 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766da69d-dd44-44fb-80b7-be8571799c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:57.919335 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766da69d-dd44-44fb-80b7-be8571799c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:57.922571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c51a665-51f3-4939-b34d-cdaed226f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:57.923531 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume 45d2c8b9-0863-46bd-a0f0-57df968a6a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'volume_size': 1} Nov 10 04:13:57.924178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] creating volume 'volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:13:57.925755 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:13:58.046268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:13:58.047202 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:13:58.050285 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c51a665-51f3-4939-b34d-cdaed226f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:58.053116 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b6b6c0-8624-468e-852c-e23e916f1164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:13:58.064919 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87 (45d2c8b9-0863-46bd-a0f0-57df968a6a87): created successfully Nov 10 04:13:58.068957 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b6b6c0-8624-468e-852c-e23e916f1164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:13:58.073749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Flow 'volume_create_manager' (248bbd31-ba85-441d-a70c-fa3159697609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:13:58.097032 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ab8f291b-e778-41fc-9a3a-65d68f0c5722 tempest-AttachVolumeShelveTestJSON-1859284425 None] Created volume successfully. Nov 10 04:14:04.137846 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-fa99a5c5-fd13-4b9b-8cf2-a98d7f07f03f tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['d04a716c-9288-458a-9000-33f3db341391', '6e3d1fb9-767c-4f4b-851e-28dba4ca557f', 'edbe12c8-b5a8-4f50-a243-826ee26ff182', '29485a19-dd0f-4d8f-9ff1-3e8f420f4132'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:14:04.201993 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fa99a5c5-fd13-4b9b-8cf2-a98d7f07f03f tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:14:04.209177 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-fa99a5c5-fd13-4b9b-8cf2-a98d7f07f03f tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-078d8821-6ead-49f3-af00-c4df945fc032-delete_snapshot'" released by "delete_snapshot" :: held 30.493s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:14:05.333221 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-65fe955e-2937-436d-a0f9-19a4b53a7d99 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-d7c8f6c3-1cc1-4dd6-ba48-c3fce5068b32-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:14:05.336483 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65fe955e-2937-436d-a0f9-19a4b53a7d99 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:14:28.538490 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:14:28.540287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:14:28.632451 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:14:28.707358 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:14:35.639998 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-65fe955e-2937-436d-a0f9-19a4b53a7d99 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['a91e2714-8f36-44b8-ac83-14c7915244df', '4059033c-9a26-4867-8a0c-f3e7cfc5458a', 'c4a13750-e400-4e7d-87da-7c34be72f471', 'fc6d46f3-aa7f-4705-96e7-29e87b11c157'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:14:35.747554 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-65fe955e-2937-436d-a0f9-19a4b53a7d99 tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:14:35.760029 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-65fe955e-2937-436d-a0f9-19a4b53a7d99 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-d7c8f6c3-1cc1-4dd6-ba48-c3fce5068b32-delete_snapshot'" released by "delete_snapshot" :: held 30.424s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:14:36.723081 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1f6fc5b3-0a08-4971-b171-efc62d20a574 req-8db3d1f9-fafe-4521-8826-894bab3dbc7e tempest-VolumesSnapshotTestJSON-106401922 None] Terminate volume connection completed successfully. Nov 10 04:14:36.729196 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-1f6fc5b3-0a08-4971-b171-efc62d20a574 req-8db3d1f9-fafe-4521-8826-894bab3dbc7e tempest-VolumesSnapshotTestJSON-106401922 None] Deleting attachment 034d9cd6-02d5-4121-ba18-95bdf0a86812. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:14:41.836656 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a0aebdd2-c490-4636-9d8f-b9d10ba9bcef req-2b7c5b6a-8e4f-4fef-b945-3884275abe22 tempest-AttachVolumeShelveTestJSON-1859284425 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:14:42.627491 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a0aebdd2-c490-4636-9d8f-b9d10ba9bcef req-2b7c5b6a-8e4f-4fef-b945-3884275abe22 tempest-AttachVolumeShelveTestJSON-1859284425 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.790s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:14:42.628413 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a0aebdd2-c490-4636-9d8f-b9d10ba9bcef req-2b7c5b6a-8e4f-4fef-b945-3884275abe22 tempest-AttachVolumeShelveTestJSON-1859284425 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:14:42.671847 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a0aebdd2-c490-4636-9d8f-b9d10ba9bcef req-2b7c5b6a-8e4f-4fef-b945-3884275abe22 tempest-AttachVolumeShelveTestJSON-1859284425 None] Connection info returned from driver {'name': 'volumes/volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '45d2c8b9-0863-46bd-a0f0-57df968a6a87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1681bf3f-e376-4fc9-9182-d381aa238680'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:14:42.753448 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a0aebdd2-c490-4636-9d8f-b9d10ba9bcef req-2b7c5b6a-8e4f-4fef-b945-3884275abe22 tempest-AttachVolumeShelveTestJSON-1859284425 None] attachment_update completed successfully. Nov 10 04:14:43.007277 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-56ba5125-22ac-442e-994c-ee53b125bc48 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:14:43.696412 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-56ba5125-22ac-442e-994c-ee53b125bc48 tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:14:44.347494 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1026ab47-31ba-48e3-b70a-f695463450bb tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-07fbce89-9626-49a8-b6a8-f61b783d7f7c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:14:44.351344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1026ab47-31ba-48e3-b70a-f695463450bb tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:14:44.690240 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-1026ab47-31ba-48e3-b70a-f695463450bb tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['55f999a7-6c6b-4217-99f5-788705caba8f', '9625330f-bbe4-4f73-a472-94cbece4a5be', '50a0b965-2f1b-4242-8ab5-2ed56b074028', 'a0023153-09de-45c1-a14d-cc783c2df81d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:14:44.741211 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1026ab47-31ba-48e3-b70a-f695463450bb tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:14:44.752477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1026ab47-31ba-48e3-b70a-f695463450bb tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-07fbce89-9626-49a8-b6a8-f61b783d7f7c-delete_snapshot'" released by "delete_snapshot" :: held 0.402s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:14:45.763137 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1b14e093-113c-4fa2-96e6-bca2a8394336 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:14:46.751618 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1b14e093-113c-4fa2-96e6-bca2a8394336 tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:15:10.704178 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-38fb92f5-e0c6-45ed-90f4-b2b9fa3b5676 req-fcb72a7d-7fbb-4f41-a5f2-455dca18e3fd tempest-VolumesSnapshotTestJSON-106401922 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:15:12.305876 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-38fb92f5-e0c6-45ed-90f4-b2b9fa3b5676 req-fcb72a7d-7fbb-4f41-a5f2-455dca18e3fd tempest-VolumesSnapshotTestJSON-106401922 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.606s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:15:12.306804 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-38fb92f5-e0c6-45ed-90f4-b2b9fa3b5676 req-fcb72a7d-7fbb-4f41-a5f2-455dca18e3fd tempest-VolumesSnapshotTestJSON-106401922 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:15:12.341795 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-38fb92f5-e0c6-45ed-90f4-b2b9fa3b5676 req-fcb72a7d-7fbb-4f41-a5f2-455dca18e3fd tempest-VolumesSnapshotTestJSON-106401922 None] Connection info returned from driver {'name': 'volumes/volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10e45ab1-9a66-45b6-a400-7c909cbde2b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8dc3fb9-176c-474a-a421-d46fa1994ea6'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:15:12.401921 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-38fb92f5-e0c6-45ed-90f4-b2b9fa3b5676 req-fcb72a7d-7fbb-4f41-a5f2-455dca18e3fd tempest-VolumesSnapshotTestJSON-106401922 None] attachment_update completed successfully. Nov 10 04:15:14.042582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0b47a6ff-d19f-4b37-af3b-103b45879d9a tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:15:14.648895 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0b47a6ff-d19f-4b37-af3b-103b45879d9a tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:15:15.394724 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8b607b84-ce85-4946-8a09-580833abbf76 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:15:15.717826 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8b607b84-ce85-4946-8a09-580833abbf76 tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:15:16.472235 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-799e7f9f-367d-4445-82ea-9990867ea8bd tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-1e6aabbf-9ceb-465e-a584-34d3f1cbeb80-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:15:16.473922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-799e7f9f-367d-4445-82ea-9990867ea8bd tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:15:28.543111 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:15:28.544176 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:15:28.596553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:15:28.658496 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:15:46.695029 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-799e7f9f-367d-4445-82ea-9990867ea8bd tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['69d4c79d-279d-42a6-9147-3a25bc4925ae', '357aa82a-5eef-4780-90de-305d3cf5eac7', 'a1d88f15-be7e-4111-b287-394d03d84bcd', 'da4f337e-d06b-4d7e-8fd2-9bb2291f03b0'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:15:46.761091 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-799e7f9f-367d-4445-82ea-9990867ea8bd tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:15:46.774134 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-799e7f9f-367d-4445-82ea-9990867ea8bd tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-1e6aabbf-9ceb-465e-a584-34d3f1cbeb80-delete_snapshot'" released by "delete_snapshot" :: held 30.302s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:15:46.863261 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-6aed7761-8d7f-488d-aab3-341e561d3478 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-05103259-7c57-45aa-b622-c8473e25ae68-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:15:46.866381 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6aed7761-8d7f-488d-aab3-341e561d3478 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:15:52.725804 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-4f24294c-02ee-4e97-bb89-7b4ffbb37796 req-e35f56da-0cdf-47f8-a42d-19a3d2caa432 tempest-AttachVolumeShelveTestJSON-1859284425 None] Terminate volume connection completed successfully. Nov 10 04:15:52.729654 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-4f24294c-02ee-4e97-bb89-7b4ffbb37796 req-e35f56da-0cdf-47f8-a42d-19a3d2caa432 tempest-AttachVolumeShelveTestJSON-1859284425 None] Deleting attachment 1681bf3f-e376-4fc9-9182-d381aa238680. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:16:17.117547 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-6aed7761-8d7f-488d-aab3-341e561d3478 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['e1ee9cf8-863d-4c94-a9d9-ddfd965b99fe', '1e33d584-3374-4e66-b4fd-4ff4dc4e37ce', 'dfcc196a-28a0-47d0-ade6-bf7a8e553582', 'b1a9bfba-aa51-413f-a872-abd8e0277fa6'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:16:17.154195 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6aed7761-8d7f-488d-aab3-341e561d3478 tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:16:17.158824 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-6aed7761-8d7f-488d-aab3-341e561d3478 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-05103259-7c57-45aa-b622-c8473e25ae68-delete_snapshot'" released by "delete_snapshot" :: held 30.296s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:18.231598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-bd25657e-4ec7-420b-a46b-35680ea96705 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-6f71b3b8-918b-4776-966c-f511627b5a97-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:18.233496 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bd25657e-4ec7-420b-a46b-35680ea96705 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:28.543661 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:16:28.544521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:28.595075 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:28.643309 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:16:32.500038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:32.504582 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:32.505280 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:32.520674 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Flow 'volume_create_manager' (775305a2-4d45-4fc6-99d5-0f02e6d671f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:32.524402 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f57d92-6ebc-4de4-9c76-1f2430426cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:32.531100 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:32.544809 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f57d92-6ebc-4de4-9c76-1f2430426cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1439424953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=84736036-4a3b-4292-9f28-8db5e133e260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06db6111f004dc79fac8e3e5d36e18f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:32Z,use_quota=True,user_id='3a078298ffaa403eb3b8563a4ca5953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:32.546510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c656787-eea7-4d20-9e70-94eaaa130bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:32.548558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c656787-eea7-4d20-9e70-94eaaa130bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:32.551200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6342b7ca-2f44-4a89-8ed3-d0a2725c5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:32.553441 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6342b7ca-2f44-4a89-8ed3-d0a2725c5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84736036-4a3b-4292-9f28-8db5e133e260', 'volume_name': 'volume-84736036-4a3b-4292-9f28-8db5e133e260', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:32.555739 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a13c049-b4a2-43f8-bc40-9e60d37ea6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:32.558327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a13c049-b4a2-43f8-bc40-9e60d37ea6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:32.560854 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a113b-87c7-4b9b-9a6f-4681b8d3ade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:32.561625 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Volume 84736036-4a3b-4292-9f28-8db5e133e260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84736036-4a3b-4292-9f28-8db5e133e260', 'volume_size': 1} Nov 10 04:16:32.562019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] creating volume 'volume-84736036-4a3b-4292-9f28-8db5e133e260' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:16:32.562995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:32.634752 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:32.635904 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:32.638008 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a113b-87c7-4b9b-9a6f-4681b8d3ade0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84736036-4a3b-4292-9f28-8db5e133e260', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:32.640270 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c87338-d160-47f4-958f-d3eeb1ed2654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:32.649058 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Volume volume-84736036-4a3b-4292-9f28-8db5e133e260 (84736036-4a3b-4292-9f28-8db5e133e260): created successfully Nov 10 04:16:32.651064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c87338-d160-47f4-958f-d3eeb1ed2654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:32.653940 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Flow 'volume_create_manager' (775305a2-4d45-4fc6-99d5-0f02e6d671f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:32.667521 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e833ae77-766c-406f-bec2-fbf1bb6b79e2 tempest-VolumesServicesTestJSON-846598186 None] Created volume successfully. Nov 10 04:16:33.699460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] Lock "b'cinder-84736036-4a3b-4292-9f28-8db5e133e260-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:33.746745 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:33.820186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:16:33.820860 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] Volume volume-84736036-4a3b-4292-9f28-8db5e133e260 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:16:33.830424 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] deleting rbd volume volume-84736036-4a3b-4292-9f28-8db5e133e260 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:16:34.113750 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] Created reservations ['5f14adee-2ae2-4e06-896e-0d7ce26d0096', 'cfd64699-e85b-471c-880f-53af3d86228b', '8fe4d73b-81be-4266-9ea4-50c5420b87f5', '833176db-4c77-47c4-acd7-23f9474b482c'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:16:34.154517 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:34.191742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:34.235873 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:16:34.240098 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] Deleted volume successfully. Nov 10 04:16:34.256813 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-35a298ba-8ac0-4ad2-a624-34d8458effcc tempest-VolumesServicesTestJSON-846598186 None] Lock "b'cinder-84736036-4a3b-4292-9f28-8db5e133e260-delete_volume'" released by "delete_volume" :: held 0.560s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:48.401686 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-bd25657e-4ec7-420b-a46b-35680ea96705 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['fbac43a6-3cdc-4f52-af27-d684e5a8b2db', '2434786a-a9af-465f-84b8-b4f5a1056c73', '7da604d1-6501-468b-8eb9-a94a2601a0c4', '91e0e499-d141-42ee-89bd-cd36e5fdc6bb'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:16:48.445003 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-bd25657e-4ec7-420b-a46b-35680ea96705 tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:16:48.451546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-bd25657e-4ec7-420b-a46b-35680ea96705 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-6f71b3b8-918b-4776-966c-f511627b5a97-delete_snapshot'" released by "delete_snapshot" :: held 30.220s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:49.725620 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:49.729785 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:49.730430 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:49.745236 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Flow 'volume_create_manager' (45a8726a-cfa3-4c08-bc40-aa3c07358400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:49.749993 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ac27e9-0fe9-408e-a2e3-3b81523bfa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:49.757866 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:49.771486 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ac27e9-0fe9-408e-a2e3-3b81523bfa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1171984642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=4508587f-22be-43c4-a2cc-d695421c77ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6928d06e60864741add16260cd032208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:50Z,use_quota=True,user_id='7944520656514721b13b560f8b1032a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e180dc06-90d7-4a06-a484-94d8209dc71e),volume_type_id=e180dc06-90d7-4a06-a484-94d8209dc71e)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:49.774108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7880da8a-eedb-4b02-8a8e-3303964778d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:49.776256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7880da8a-eedb-4b02-8a8e-3303964778d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:49.778612 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625713c4-bd0b-4be3-82a2-9af6a50cabfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:49.780843 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625713c4-bd0b-4be3-82a2-9af6a50cabfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4508587f-22be-43c4-a2cc-d695421c77ce', 'volume_name': 'volume-4508587f-22be-43c4-a2cc-d695421c77ce', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:49.783076 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3507ae27-2acb-4f28-aeba-6573f23712f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:49.785178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3507ae27-2acb-4f28-aeba-6573f23712f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:49.787314 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30704f46-aaa3-48f7-ba8a-d8aafc425d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:49.788085 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Volume 4508587f-22be-43c4-a2cc-d695421c77ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4508587f-22be-43c4-a2cc-d695421c77ce', 'volume_size': 1} Nov 10 04:16:49.788481 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] creating volume 'volume-4508587f-22be-43c4-a2cc-d695421c77ce' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:16:49.789487 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:49.840581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:49.840990 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:49.843016 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30704f46-aaa3-48f7-ba8a-d8aafc425d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4508587f-22be-43c4-a2cc-d695421c77ce', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:49.845238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0792f28d-a2e8-4cca-92d7-de7bcad08d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:49.854513 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Volume volume-4508587f-22be-43c4-a2cc-d695421c77ce (4508587f-22be-43c4-a2cc-d695421c77ce): created successfully Nov 10 04:16:49.856436 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0792f28d-a2e8-4cca-92d7-de7bcad08d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:49.859294 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Flow 'volume_create_manager' (45a8726a-cfa3-4c08-bc40-aa3c07358400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:49.867464 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6150dab0-3ab2-4065-87d4-7ee07b074931 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Created volume successfully. Nov 10 04:16:50.147157 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-3436588e-9d0f-4ba0-87c7-09bca34bfefd req-7d4dc1cd-f781-4430-bca4-b1478c57dfa7 tempest-VolumesSnapshotTestJSON-106401922 None] Terminate volume connection completed successfully. Nov 10 04:16:50.147630 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-3436588e-9d0f-4ba0-87c7-09bca34bfefd req-7d4dc1cd-f781-4430-bca4-b1478c57dfa7 tempest-VolumesSnapshotTestJSON-106401922 None] Deleting attachment f8dc3fb9-176c-474a-a421-d46fa1994ea6. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:16:51.118379 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94266dec-be30-4688-a693-daf70dd5c325 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:51.164858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94266dec-be30-4688-a693-daf70dd5c325 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:51.216097 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-94266dec-be30-4688-a693-daf70dd5c325 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:16:51.221707 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-94266dec-be30-4688-a693-daf70dd5c325 tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Retype volume completed successfully. Nov 10 04:16:52.497506 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Lock "b'cinder-4508587f-22be-43c4-a2cc-d695421c77ce-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:52.539047 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:52.621388 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:16:52.621868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Volume volume-4508587f-22be-43c4-a2cc-d695421c77ce is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:16:52.640777 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] deleting rbd volume volume-4508587f-22be-43c4-a2cc-d695421c77ce {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:16:52.812519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:52.821581 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:52.826300 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:52.856454 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (4e3a9240-61d4-4d81-afb8-0fa642870ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:52.861548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5301b0f4-f0ca-41ed-aecf-2c5f8234d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:52.875516 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:52.906266 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5301b0f4-f0ca-41ed-aecf-2c5f8234d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1834346187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=242c1f00-14da-49b7-ab05-57ce44f52845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac8c622c5e44556b123f0c76f41e8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:53Z,use_quota=True,user_id='5726a431e6ec4dcc90bae2ec9cd07bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:52.908775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592641c9-b7df-4b5e-9547-c3944570383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:52.910886 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592641c9-b7df-4b5e-9547-c3944570383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:52.913229 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1e95e4-8825-43b7-b391-e71701e84d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:52.915339 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1e95e4-8825-43b7-b391-e71701e84d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242c1f00-14da-49b7-ab05-57ce44f52845', 'volume_name': 'volume-242c1f00-14da-49b7-ab05-57ce44f52845', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:52.931224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf350355-435b-4242-8ca0-4b62ad7d433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:52.934351 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf350355-435b-4242-8ca0-4b62ad7d433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:52.946321 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6ea1a2-18da-4a35-b772-f39738607244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:52.947185 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Volume 242c1f00-14da-49b7-ab05-57ce44f52845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242c1f00-14da-49b7-ab05-57ce44f52845', 'volume_size': 1} Nov 10 04:16:52.947571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] creating volume 'volume-242c1f00-14da-49b7-ab05-57ce44f52845' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:16:52.948567 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:53.062758 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:16:53.064277 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:16:53.080988 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:53.081812 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:53.084165 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6ea1a2-18da-4a35-b772-f39738607244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242c1f00-14da-49b7-ab05-57ce44f52845', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:53.086412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc13a3a7-3615-4df1-997c-99d718725a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:53.098228 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Created reservations ['85e1fab3-98fc-4f98-a0d8-338b3dc60e06', 'cc189d57-9c60-443b-8e6a-d6683e8a1370', 'c7090b2d-c667-44f2-a94e-85fa85871ac5', '6244a7d8-3820-4801-9d22-f810403a3675'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:16:53.102261 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Volume volume-242c1f00-14da-49b7-ab05-57ce44f52845 (242c1f00-14da-49b7-ab05-57ce44f52845): created successfully Nov 10 04:16:53.105069 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc13a3a7-3615-4df1-997c-99d718725a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:53.107883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (4e3a9240-61d4-4d81-afb8-0fa642870ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:53.121633 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b7eec21f-4f86-4d46-a07b-17f536ba3a8a tempest-VolumesActionsTest-39774177 None] Created volume successfully. Nov 10 04:16:53.161948 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:53.197260 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:53.232079 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:16:53.246473 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Deleted volume successfully. Nov 10 04:16:53.262998 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a192f52e-7381-4cf6-bfb5-e6d64f2137be tempest-VolumeRetypeWithoutMigrationTest-404496023 None] Lock "b'cinder-4508587f-22be-43c4-a2cc-d695421c77ce-delete_volume'" released by "delete_volume" :: held 0.765s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:53.820730 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ffbb7758-a794-420b-b487-8dd2df69b87f tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845'" acquired by "attach_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:53.886731 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ffbb7758-a794-420b-b487-8dd2df69b87f tempest-VolumesActionsTest-39774177 None] Attaching volume 242c1f00-14da-49b7-ab05-57ce44f52845 to instance 2cc83308-26e7-4242-83f8-c34c207a7165 at mountpoint /dev/sdb on host None. Nov 10 04:16:53.920565 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ffbb7758-a794-420b-b487-8dd2df69b87f tempest-VolumesActionsTest-39774177 None] Attach volume completed successfully. Nov 10 04:16:53.927119 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ffbb7758-a794-420b-b487-8dd2df69b87f tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845'" released by "attach_volume" :: held 0.107s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:54.500371 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-04addae5-7269-4b80-a616-c08d5d18a7f8 tempest-VolumesActionsTest-765642991 None] Terminate volume connection completed successfully. Nov 10 04:16:54.546370 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-04addae5-7269-4b80-a616-c08d5d18a7f8 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845-detach_volume'" acquired by "detach_volume" :: waited 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:54.560241 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-04addae5-7269-4b80-a616-c08d5d18a7f8 tempest-VolumesActionsTest-765642991 None] Detaching volume 242c1f00-14da-49b7-ab05-57ce44f52845 from instance 2cc83308-26e7-4242-83f8-c34c207a7165. Nov 10 04:16:54.634298 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-04addae5-7269-4b80-a616-c08d5d18a7f8 tempest-VolumesActionsTest-765642991 None] Detach volume completed successfully. Nov 10 04:16:54.643046 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-04addae5-7269-4b80-a616-c08d5d18a7f8 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845-detach_volume'" released by "detach_volume" :: held 0.096s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:54.861033 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b8fcf3d6-5a1e-469e-86b4-23ecf13104ec tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845-detach_volume'" acquired by "detach_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:54.865185 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b8fcf3d6-5a1e-469e-86b4-23ecf13104ec tempest-VolumesActionsTest-39774177 None] Volume detach called, but volume not attached. Nov 10 04:16:54.892124 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b8fcf3d6-5a1e-469e-86b4-23ecf13104ec tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845-detach_volume'" released by "detach_volume" :: held 0.032s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:54.992626 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:54.996835 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:54.997732 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:55.010135 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (68a8b5d6-06cc-4a0c-b339-c52f5e605ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:55.013470 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6874ec1-fa10-4f7f-aec2-38ddfee39d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:55.020779 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:55.035311 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6874ec1-fa10-4f7f-aec2-38ddfee39d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1377241205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b3c1571a-d580-4a0d-b374-f671ae9ae50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b41fe8af644d33915bdae4bbd34947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:55Z,use_quota=True,user_id='b14e52c2dee142bb896f6e0e61e52426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:55.038236 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ce1d39-1bf3-4e72-945f-f5ce45a9533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:55.041320 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ce1d39-1bf3-4e72-945f-f5ce45a9533d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:55.043843 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5f510f-1ed2-4150-8806-7aaf08503f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:55.046289 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5f510f-1ed2-4150-8806-7aaf08503f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c1571a-d580-4a0d-b374-f671ae9ae50c', 'volume_name': 'volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:55.048932 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0076f1-01a5-4fb5-b0cb-ccc6c2850dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:55.051209 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0076f1-01a5-4fb5-b0cb-ccc6c2850dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:55.053380 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29d4d1e-6d9c-4d4f-8745-dfeaef336d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:55.054142 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Volume b3c1571a-d580-4a0d-b374-f671ae9ae50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c', 'volume_size': 1} Nov 10 04:16:55.054733 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] creating volume 'volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:16:55.055903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:55.144511 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:55.145228 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:55.149625 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29d4d1e-6d9c-4d4f-8745-dfeaef336d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:55.153354 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaaa61d-ba89-4a35-80e7-fcf6fd6fea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:55.162544 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c (b3c1571a-d580-4a0d-b374-f671ae9ae50c): created successfully Nov 10 04:16:55.165127 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaaa61d-ba89-4a35-80e7-fcf6fd6fea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:55.168130 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (68a8b5d6-06cc-4a0c-b339-c52f5e605ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:55.178866 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-90bf00e4-75e7-4263-9b69-fa40d726b0a3 tempest-VolumesSnapshotTestJSON-106401922 None] Created volume successfully. Nov 10 04:16:56.216900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c01822d-3f15-4190-80d6-a8c986f95923 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:56.900052 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4c01822d-3f15-4190-80d6-a8c986f95923 tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:16:57.652138 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:57.659458 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:57.659966 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:57.674911 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Flow 'volume_create_manager' (6bc4f059-3b72-4e5e-90e1-bbd1f9880be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:57.678021 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28973f5b-5be7-4c40-bf51-dd4b714eaa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.705531 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:57.726287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28973f5b-5be7-4c40-bf51-dd4b714eaa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-762076643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1dfb0655-0a83-46d9-88eb-a8a21d5e2011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fad32e8e174d6fb68f4194d876f3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:58Z,use_quota=True,user_id='e41104ed714744aebd5aecb1a64f14c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b38d491-baef-40d2-94c4-0a622fa16e8b),volume_type_id=9b38d491-baef-40d2-94c4-0a622fa16e8b)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.729305 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5ee58d-b1c8-4298-9fe7-e487df651d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.731436 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5ee58d-b1c8-4298-9fe7-e487df651d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.733813 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499c1b34-6473-4fb7-976c-56b7dffe56d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.736375 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499c1b34-6473-4fb7-976c-56b7dffe56d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfb0655-0a83-46d9-88eb-a8a21d5e2011', 'volume_name': 'volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.739179 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05da3d7a-ff17-4dda-854d-4bdf4ba506c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.741757 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05da3d7a-ff17-4dda-854d-4bdf4ba506c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.744429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cf86a5-4249-463c-ac05-b21789f076aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.745540 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Volume 1dfb0655-0a83-46d9-88eb-a8a21d5e2011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011', 'volume_size': 1} Nov 10 04:16:57.746313 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] creating volume 'volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:16:57.748074 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:57.840939 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:57.845062 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:57.846611 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:57.888458 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (afe013ea-9b56-44db-95da-619eb8ff7333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:57.893660 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512c205d-4c8e-4412-85d4-0618426d67eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.900598 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:57.914755 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:57.915612 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:57.917949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cf86a5-4249-463c-ac05-b21789f076aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.920326 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770fa577-6669-485d-ad8b-95fa3ba65b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.933841 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512c205d-4c8e-4412-85d4-0618426d67eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1012277632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=6297dd72-3f42-4104-b634-3a3cb59f5d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b41fe8af644d33915bdae4bbd34947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6aafd3ba-cba0-4291-8361-a4d8a33281c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:58Z,use_quota=True,user_id='b14e52c2dee142bb896f6e0e61e52426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.939711 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecdee87-4138-4566-a15f-e7857c663588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.941940 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecdee87-4138-4566-a15f-e7857c663588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.944475 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fc3d88-483b-432d-8606-45646f35d93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.946563 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fc3d88-483b-432d-8606-45646f35d93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6297dd72-3f42-4104-b634-3a3cb59f5d03', 'volume_name': 'volume-6297dd72-3f42-4104-b634-3a3cb59f5d03', 'volume_size': 2, 'snapshot_id': '6aafd3ba-cba0-4291-8361-a4d8a33281c3'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.949399 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f57c56f-e298-41af-b7ed-dbde5887db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.951469 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f57c56f-e298-41af-b7ed-dbde5887db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:57.953894 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056eaf9d-3659-44fd-8e9a-2a29e8400460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:57.954664 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Volume 6297dd72-3f42-4104-b634-3a3cb59f5d03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6297dd72-3f42-4104-b634-3a3cb59f5d03', 'volume_size': 2, 'snapshot_id': '6aafd3ba-cba0-4291-8361-a4d8a33281c3'} Nov 10 04:16:57.987192 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] cloning volumes/volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c@snapshot-6aafd3ba-cba0-4291-8361-a4d8a33281c3 to volume-6297dd72-3f42-4104-b634-3a3cb59f5d03 {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:16:57.988119 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:58.026299 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:58.047483 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Volume volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011 (1dfb0655-0a83-46d9-88eb-a8a21d5e2011): created successfully Nov 10 04:16:58.049558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770fa577-6669-485d-ad8b-95fa3ba65b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:58.052342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Flow 'volume_create_manager' (6bc4f059-3b72-4e5e-90e1-bbd1f9880be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:58.062606 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f6fb86ea-beae-406e-8f4c-c0fbe38aacde tempest-VolumeTypesTest-1122806844 None] Created volume successfully. Nov 10 04:16:58.148351 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:58.148889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:58.153438 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:58.260318 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056eaf9d-3659-44fd-8e9a-2a29e8400460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6297dd72-3f42-4104-b634-3a3cb59f5d03', 'volume_size': 2, 'snapshot_id': '6aafd3ba-cba0-4291-8361-a4d8a33281c3'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:58.262479 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511e538b-1543-4c8c-a05e-9cf9a71407d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:58.270396 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-6297dd72-3f42-4104-b634-3a3cb59f5d03 (6297dd72-3f42-4104-b634-3a3cb59f5d03): created successfully Nov 10 04:16:58.272669 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511e538b-1543-4c8c-a05e-9cf9a71407d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:58.276205 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (afe013ea-9b56-44db-95da-619eb8ff7333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:58.288261 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d8ce6bf0-e98b-4227-b321-bcb550a55f24 tempest-VolumesSnapshotTestJSON-106401922 None] Created volume successfully. Nov 10 04:16:58.795532 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-6297dd72-3f42-4104-b634-3a3cb59f5d03-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:16:58.905022 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:59.015614 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:16:59.030793 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-6297dd72-3f42-4104-b634-3a3cb59f5d03 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:16:59.109997 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f1d36f3-6fc5-4b5f-8aad-645ea633b6cd tempest-VolumeTypesTest-1122806844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:59.169635 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f1d36f3-6fc5-4b5f-8aad-645ea633b6cd tempest-VolumeTypesTest-1122806844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:59.223019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-1f1d36f3-6fc5-4b5f-8aad-645ea633b6cd tempest-VolumeTypesTest-1122806844 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:16:59.227781 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1f1d36f3-6fc5-4b5f-8aad-645ea633b6cd tempest-VolumeTypesTest-1122806844 None] Retype volume completed successfully. Nov 10 04:16:59.357883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['e5573815-8f1f-4434-9369-d73d75543006', '378bfbc3-524c-4d9c-bb59-28ceddf5b76f', '307158a2-c0cd-4ac7-9fa7-4b96051e2ed7', '5185f6b6-146f-47cc-9015-ecba7a6d8b4a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:16:59.414902 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:16:59.418951 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:16:59.419393 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:16:59.432012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (1532953a-73a4-48c9-be49-f93cc00dd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:59.435089 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8989e4fe-30cb-409e-a8ee-57a0a0b1bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:59.439468 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:59.467160 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:59.494663 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:16:59.501092 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:16:59.502511 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:16:59.515556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8989e4fe-30cb-409e-a8ee-57a0a0b1bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1397492494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=3d93fb40-ef5b-4d41-889f-35716c6775a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac8c622c5e44556b123f0c76f41e8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:16:59Z,use_quota=True,user_id='5726a431e6ec4dcc90bae2ec9cd07bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:59.518100 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5150a9-f190-45e3-8f16-9e7de573563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:59.520217 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5150a9-f190-45e3-8f16-9e7de573563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:59.522629 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2fcc2a-3858-4634-a136-6e591f59e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:59.525275 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2fcc2a-3858-4634-a136-6e591f59e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d93fb40-ef5b-4d41-889f-35716c6775a7', 'volume_name': 'volume-3d93fb40-ef5b-4d41-889f-35716c6775a7', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:59.527525 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dac27a6-4ec9-4ece-9ddd-61690e930122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:59.529785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dac27a6-4ec9-4ece-9ddd-61690e930122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:59.532101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4a229a-83b2-49eb-bb60-79ce6118a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:59.532914 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Volume 3d93fb40-ef5b-4d41-889f-35716c6775a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d93fb40-ef5b-4d41-889f-35716c6775a7', 'volume_size': 1} Nov 10 04:16:59.533302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] creating volume 'volume-3d93fb40-ef5b-4d41-889f-35716c6775a7' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:16:59.534027 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:16:59.567432 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-544a9a5b-b58a-451b-a5f1-83876c65025e tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-6297dd72-3f42-4104-b634-3a3cb59f5d03-delete_volume'" released by "delete_volume" :: held 0.772s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:16:59.591478 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:16:59.591883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:16:59.594091 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4a229a-83b2-49eb-bb60-79ce6118a538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d93fb40-ef5b-4d41-889f-35716c6775a7', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:59.596245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6f8ede-4002-4e41-a9be-1b436ea69340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:16:59.605708 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Volume volume-3d93fb40-ef5b-4d41-889f-35716c6775a7 (3d93fb40-ef5b-4d41-889f-35716c6775a7): created successfully Nov 10 04:16:59.607678 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6f8ede-4002-4e41-a9be-1b436ea69340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:16:59.610714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (1532953a-73a4-48c9-be49-f93cc00dd431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:16:59.618762 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-211d50b1-9d59-496e-91b9-a6efee38e017 tempest-VolumesActionsTest-39774177 None] Created volume successfully. Nov 10 04:17:00.273797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:00.277489 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:00.277944 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:00.289862 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (b9004a85-a74a-4a98-bf9d-f88fe2a83b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:00.293489 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ea9012-d44d-4d67-93a0-dd0d4441d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:00.299997 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:00.313768 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ea9012-d44d-4d67-93a0-dd0d4441d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-134029874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=44fe3e69-09db-4448-8cde-93202ceb3bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b41fe8af644d33915bdae4bbd34947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:00Z,use_quota=True,user_id='b14e52c2dee142bb896f6e0e61e52426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:00.316342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22060f75-371c-49de-bca5-755fd09ba252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:00.318496 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22060f75-371c-49de-bca5-755fd09ba252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:00.320839 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4bddd6-6ae0-4eed-8e2d-51991f35d4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:00.323618 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4bddd6-6ae0-4eed-8e2d-51991f35d4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fe3e69-09db-4448-8cde-93202ceb3bf4', 'volume_name': 'volume-44fe3e69-09db-4448-8cde-93202ceb3bf4', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:00.325912 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9093838f-4c73-4da6-8379-82a85db29105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:00.328279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9093838f-4c73-4da6-8379-82a85db29105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:00.330453 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869d650-6118-44ed-b327-426c6cb0f8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:00.331222 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Volume 44fe3e69-09db-4448-8cde-93202ceb3bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fe3e69-09db-4448-8cde-93202ceb3bf4', 'volume_size': 1} Nov 10 04:17:00.331616 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] creating volume 'volume-44fe3e69-09db-4448-8cde-93202ceb3bf4' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:00.332599 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:00.416814 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:00.417191 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:00.419197 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b869d650-6118-44ed-b327-426c6cb0f8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fe3e69-09db-4448-8cde-93202ceb3bf4', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:00.421555 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ae48f9-a830-4628-b624-e4c278554965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:00.434886 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-44fe3e69-09db-4448-8cde-93202ceb3bf4 (44fe3e69-09db-4448-8cde-93202ceb3bf4): created successfully Nov 10 04:17:00.437578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ae48f9-a830-4628-b624-e4c278554965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:00.445652 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (b9004a85-a74a-4a98-bf9d-f88fe2a83b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:00.464046 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e5939e77-f34e-48c8-b9ce-914ae6ce76cd tempest-VolumesSnapshotTestJSON-106401922 None] Created volume successfully. Nov 10 04:17:00.642452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-3d93fb40-ef5b-4d41-889f-35716c6775a7-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:00.689007 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:00.749480 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:00.749988 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] Volume volume-3d93fb40-ef5b-4d41-889f-35716c6775a7 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:00.758726 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] deleting rbd volume volume-3d93fb40-ef5b-4d41-889f-35716c6775a7 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:00.991426 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Lock "b'cinder-1dfb0655-0a83-46d9-88eb-a8a21d5e2011-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:01.035813 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:01.074189 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:01.074724 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Volume volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:01.080030 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] deleting rbd volume volume-1dfb0655-0a83-46d9-88eb-a8a21d5e2011 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:01.127579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] Created reservations ['91e884fd-2c2d-4504-a28c-d78e3a6df845', 'b2b88ffa-5a56-4c9e-81b1-6e184c800807', '13ca2aed-ab1e-4148-9656-0374419208a4', '064de8cf-90c3-464c-a1b3-968797a5f1e2'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:01.181280 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:01.244574 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:01.316118 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:01.322188 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] Deleted volume successfully. Nov 10 04:17:01.342123 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8cecabbc-40a8-4b07-a391-44321d057b13 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-3d93fb40-ef5b-4d41-889f-35716c6775a7-delete_volume'" released by "delete_volume" :: held 0.700s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:01.378730 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-549843990 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-549843990, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:17:01.379695 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-549843990 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-549843990, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:17:01.401752 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Created reservations ['a9671a08-50b3-425e-b54b-94b532d9bcdb', 'dd4d1bc2-60d8-45fc-9741-cd2cddef72d4', 'd172a2ee-fa5d-4bd7-b049-2e7c35a053ef', '092a2f66-ba99-4e31-b6a6-50180578dda0'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:01.461482 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:01.503147 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:01.557456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:01.574412 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Deleted volume successfully. Nov 10 04:17:01.612905 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-219a7beb-2091-48c6-97ee-59b92e2c7e98 tempest-VolumeTypesTest-1122806844 None] Lock "b'cinder-1dfb0655-0a83-46d9-88eb-a8a21d5e2011-delete_volume'" released by "delete_volume" :: held 0.621s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:01.626573 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2dd86604-ef00-4e77-a591-31b79435f673 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:02.007591 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:02.011548 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:02.011998 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:02.023777 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (d60fcb7c-b448-427b-9ca6-a285d0847f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:02.027609 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1d03a7-03e2-4c92-b38e-257d4ba1aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:02.033912 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:02.046304 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1d03a7-03e2-4c92-b38e-257d4ba1aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33674118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=e54a7074-ae39-4f3c-8525-21bc46fd2d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac8c622c5e44556b123f0c76f41e8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:02Z,use_quota=True,user_id='5726a431e6ec4dcc90bae2ec9cd07bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:02.048902 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545e7e79-9cab-4ba7-97ee-ca8a2282c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:02.051026 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545e7e79-9cab-4ba7-97ee-ca8a2282c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:02.053385 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a84ba-eed0-4acc-bc5b-8c77b84e74f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:02.055715 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a84ba-eed0-4acc-bc5b-8c77b84e74f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54a7074-ae39-4f3c-8525-21bc46fd2d19', 'volume_name': 'volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:02.058050 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0d3844-99ce-4024-afba-c4a9e0e562fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:02.060515 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0d3844-99ce-4024-afba-c4a9e0e562fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:02.062793 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b308b4e-cab8-4803-8050-ba197340b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:02.063448 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Volume e54a7074-ae39-4f3c-8525-21bc46fd2d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19', 'volume_size': 1} Nov 10 04:17:02.063845 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] creating volume 'volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:02.064861 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:02.121303 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:02.121756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:02.125877 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b308b4e-cab8-4803-8050-ba197340b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:02.127997 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7960d1-0bc9-42cc-9a43-09252a7f0722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:02.137301 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Volume volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19 (e54a7074-ae39-4f3c-8525-21bc46fd2d19): created successfully Nov 10 04:17:02.139143 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7960d1-0bc9-42cc-9a43-09252a7f0722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:02.142058 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (d60fcb7c-b448-427b-9ca6-a285d0847f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:02.149709 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-df299ad9-0284-40ff-be6b-1d90d210f671 tempest-VolumesActionsTest-39774177 None] Created volume successfully. Nov 10 04:17:02.583142 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2dd86604-ef00-4e77-a591-31b79435f673 tempest-VolumesSnapshotTestJSON-106401922 None] Create snapshot completed successfully Nov 10 04:17:03.178002 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-e54a7074-ae39-4f3c-8525-21bc46fd2d19-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:03.201636 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:03.250732 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:03.254267 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] Volume volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:03.261995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] deleting rbd volume volume-e54a7074-ae39-4f3c-8525-21bc46fd2d19 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:03.531554 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] Created reservations ['2f57742f-c61d-4e1e-9d1b-1dbb4abe0ea1', '1d6cc1e2-368c-4928-bb56-251228f9ea09', 'e03983ed-8acd-4b91-9e48-5c7cc50eba2e', '5310f6c3-cf6a-4738-9559-c71f23143aec'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:03.575047 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:03.602178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:03.634747 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:03.641821 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] Deleted volume successfully. Nov 10 04:17:03.656235 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-96703395-0cb4-47c0-92a1-2d5243223952 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-e54a7074-ae39-4f3c-8525-21bc46fd2d19-delete_volume'" released by "delete_volume" :: held 0.478s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:03.911663 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:03.916704 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:03.917156 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:03.939294 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (752735b6-f75c-41e6-af5b-db6b2df8c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:03.942668 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0bbf37-468a-4f50-994a-b92a0b9e90f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:03.951710 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:03.963219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0bbf37-468a-4f50-994a-b92a0b9e90f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1684792172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=2aba1047-216d-421e-8e20-a9d9bf62e724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b41fe8af644d33915bdae4bbd34947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eecfa7db-0a13-4179-aee3-afcfc1a57843,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:04Z,use_quota=True,user_id='b14e52c2dee142bb896f6e0e61e52426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:03.966562 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d0252c-a244-49a3-b720-369f34142b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:03.969367 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d0252c-a244-49a3-b720-369f34142b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:03.972167 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f28c5f-14ea-49cb-85f6-751139d352c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:03.975486 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f28c5f-14ea-49cb-85f6-751139d352c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2aba1047-216d-421e-8e20-a9d9bf62e724', 'volume_name': 'volume-2aba1047-216d-421e-8e20-a9d9bf62e724', 'volume_size': 1, 'snapshot_id': 'eecfa7db-0a13-4179-aee3-afcfc1a57843'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:03.978043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861af521-f5b0-4137-bddf-2cedf66507eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:03.980249 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861af521-f5b0-4137-bddf-2cedf66507eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:03.982537 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b772394-41c8-4015-ab07-1a5573c293b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:03.983423 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Volume 2aba1047-216d-421e-8e20-a9d9bf62e724: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2aba1047-216d-421e-8e20-a9d9bf62e724', 'volume_size': 1, 'snapshot_id': 'eecfa7db-0a13-4179-aee3-afcfc1a57843'} Nov 10 04:17:04.002526 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] cloning volumes/volume-44fe3e69-09db-4448-8cde-93202ceb3bf4@snapshot-eecfa7db-0a13-4179-aee3-afcfc1a57843 to volume-2aba1047-216d-421e-8e20-a9d9bf62e724 {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:17:04.003559 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:04.057560 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:04.222238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:04.222238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:04.243943 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b772394-41c8-4015-ab07-1a5573c293b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aba1047-216d-421e-8e20-a9d9bf62e724', 'volume_size': 1, 'snapshot_id': 'eecfa7db-0a13-4179-aee3-afcfc1a57843'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.246301 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2064f4-b878-4d81-9f10-c5d9ca115f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.257777 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-2aba1047-216d-421e-8e20-a9d9bf62e724 (2aba1047-216d-421e-8e20-a9d9bf62e724): created successfully Nov 10 04:17:04.261742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2064f4-b878-4d81-9f10-c5d9ca115f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.265940 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Flow 'volume_create_manager' (752735b6-f75c-41e6-af5b-db6b2df8c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:04.285441 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-dbbbee0e-1d86-467b-940e-660e943d0993 tempest-VolumesSnapshotTestJSON-106401922 None] Created volume successfully. Nov 10 04:17:04.605085 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:04.611098 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:04.611739 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:04.624885 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (81e8ef40-49df-4c70-a406-cf6b2c9f9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:04.628424 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68de57-fbf4-4b8e-bcf9-1e6df1c09467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.635983 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:04.647860 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68de57-fbf4-4b8e-bcf9-1e6df1c09467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2037761497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=08260f77-5301-4e13-b373-7b0ecb4943d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac8c622c5e44556b123f0c76f41e8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:05Z,use_quota=True,user_id='5726a431e6ec4dcc90bae2ec9cd07bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.650510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be249ba-6473-4edf-a285-325780407a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.652681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be249ba-6473-4edf-a285-325780407a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.655084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cb411e-cb4c-4a72-8a00-f3350cd10f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.657350 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cb411e-cb4c-4a72-8a00-f3350cd10f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08260f77-5301-4e13-b373-7b0ecb4943d5', 'volume_name': 'volume-08260f77-5301-4e13-b373-7b0ecb4943d5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.659624 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb781994-3681-471b-8385-43dc4bf6cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.661778 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb781994-3681-471b-8385-43dc4bf6cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.663956 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58071c40-4753-48ec-8f51-c75b7500d566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.664834 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Volume 08260f77-5301-4e13-b373-7b0ecb4943d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08260f77-5301-4e13-b373-7b0ecb4943d5', 'volume_size': 1} Nov 10 04:17:04.665324 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] creating volume 'volume-08260f77-5301-4e13-b373-7b0ecb4943d5' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:04.666275 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:04.722602 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:04.722982 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:04.725079 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58071c40-4753-48ec-8f51-c75b7500d566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08260f77-5301-4e13-b373-7b0ecb4943d5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.727218 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3403de00-115d-4488-9504-139883a4b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:04.735858 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Volume volume-08260f77-5301-4e13-b373-7b0ecb4943d5 (08260f77-5301-4e13-b373-7b0ecb4943d5): created successfully Nov 10 04:17:04.737848 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3403de00-115d-4488-9504-139883a4b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:04.740743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (81e8ef40-49df-4c70-a406-cf6b2c9f9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:04.749229 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-c1360214-ae48-4333-8206-799257d31269 tempest-VolumesActionsTest-39774177 None] Created volume successfully. Nov 10 04:17:05.011388 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-2aba1047-216d-421e-8e20-a9d9bf62e724-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:05.045157 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:05.104294 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:05.113125 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-2aba1047-216d-421e-8e20-a9d9bf62e724 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:05.358179 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['d49ae048-220d-4675-8224-18ffbdf0a6eb', '75e6e48e-37d7-4038-9e15-f779c4a67976', 'f021b5a7-b657-4897-afe4-d8080a56d392', '8ccbf044-5322-46e8-b85a-3a0b66de224a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:05.400133 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:05.427448 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:05.451860 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:05.456038 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:17:05.469613 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0292d5e0-910b-4bda-83ef-4728deeaa9d5 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-2aba1047-216d-421e-8e20-a9d9bf62e724-delete_volume'" released by "delete_volume" :: held 0.458s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:05.765523 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-08260f77-5301-4e13-b373-7b0ecb4943d5-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:05.793501 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:05.836658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:05.837138 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] Volume volume-08260f77-5301-4e13-b373-7b0ecb4943d5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:05.843191 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] deleting rbd volume volume-08260f77-5301-4e13-b373-7b0ecb4943d5 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:06.092273 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] Created reservations ['e2a047e7-f720-4acb-a925-edf8ce3c3a2d', '3a6dcac2-9ab5-428e-9efa-c120df29ac39', 'e9100ff9-143b-430c-8ce2-a67c5f75dce1', '364aa1b5-bf1d-46f5-b7ec-b10eab9cca66'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:06.169575 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:06.255311 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:06.299542 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:06.326447 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] Deleted volume successfully. Nov 10 04:17:06.345167 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:06.348400 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:06.348879 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:06.365861 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Flow 'volume_create_manager' (7b3466a1-8278-4055-a9b0-78ceaa7316f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:06.367705 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b4d3db-ee2a-499a-9f76-3fb567fbb890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:06.372492 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-615b6d8e-c6c6-4f20-b9b7-e8be164e68db tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-eecfa7db-0a13-4179-aee3-afcfc1a57843-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.065s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:06.374414 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-615b6d8e-c6c6-4f20-b9b7-e8be164e68db tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:06.435244 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:06.446982 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-002a9b36-86d7-42fb-b4ef-b3587cb300ba tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-08260f77-5301-4e13-b373-7b0ecb4943d5-delete_volume'" released by "delete_volume" :: held 0.681s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:06.460376 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b4d3db-ee2a-499a-9f76-3fb567fbb890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2118474117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13258b52b4254a4dbfb61a71094668c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:06Z,use_quota=True,user_id='3a6732c9dee4449580a1e7248988f91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:06.463004 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f7263a-fd65-4345-8c3a-07a67aad2fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:06.465185 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f7263a-fd65-4345-8c3a-07a67aad2fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:06.467862 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1eedb46-ac6a-40da-8407-a1c5af6f74aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:06.470384 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1eedb46-ac6a-40da-8407-a1c5af6f74aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f', 'volume_name': 'volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:06.472643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f98f96a-2277-4a3d-9185-9e3201cd7573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:06.474621 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f98f96a-2277-4a3d-9185-9e3201cd7573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:06.476800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf14990-68d0-4188-9cf8-68679846fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:06.477579 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Volume fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f', 'volume_size': 1} Nov 10 04:17:06.478529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] creating volume 'volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:06.479292 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:06.580044 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:06.580534 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:06.582685 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf14990-68d0-4188-9cf8-68679846fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:06.584923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae33ee99-1208-4c92-9258-267c6a2b676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:06.594959 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Volume volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f (fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f): created successfully Nov 10 04:17:06.596903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae33ee99-1208-4c92-9258-267c6a2b676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:06.599873 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Flow 'volume_create_manager' (7b3466a1-8278-4055-a9b0-78ceaa7316f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:06.611283 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f8ee563f-164c-4ea8-83bd-bfeaecf5fbc6 tempest-VolumesDeleteCascade-847203 None] Created volume successfully. Nov 10 04:17:07.117427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:07.121052 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:07.121568 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:07.133177 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (c5e0cd31-d9de-48c6-ac2b-c93c565a1f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:07.139967 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c427b9f-e139-401d-b84d-04672169bbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:07.146243 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:07.159622 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c427b9f-e139-401d-b84d-04672169bbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1379328323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=35f95b1e-dc50-44dc-ad8b-147ce3c5b022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac8c622c5e44556b123f0c76f41e8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:07Z,use_quota=True,user_id='5726a431e6ec4dcc90bae2ec9cd07bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:07.162156 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0418f695-ec71-460e-8519-867581add76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:07.164533 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0418f695-ec71-460e-8519-867581add76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:07.167013 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea00f80-6382-4678-a29d-9678726ebc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:07.169557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea00f80-6382-4678-a29d-9678726ebc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f95b1e-dc50-44dc-ad8b-147ce3c5b022', 'volume_name': 'volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:07.171378 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642802f2-cf1e-43dd-be25-4ba180023761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:07.173491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642802f2-cf1e-43dd-be25-4ba180023761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:07.175644 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39e5fef-d582-405e-8dec-c17cf4e298ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:07.176374 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Volume 35f95b1e-dc50-44dc-ad8b-147ce3c5b022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022', 'volume_size': 1} Nov 10 04:17:07.176792 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] creating volume 'volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:07.177772 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:07.231619 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:07.231993 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:07.235037 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39e5fef-d582-405e-8dec-c17cf4e298ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:07.236777 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f49688-bb4c-4d93-8733-525377cd1c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:07.249066 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Volume volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022 (35f95b1e-dc50-44dc-ad8b-147ce3c5b022): created successfully Nov 10 04:17:07.251800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f49688-bb4c-4d93-8733-525377cd1c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:07.255318 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (c5e0cd31-d9de-48c6-ac2b-c93c565a1f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:07.266913 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1d5c7642-9ab7-4f5d-a0b5-c8357282147a tempest-VolumesActionsTest-39774177 None] Created volume successfully. Nov 10 04:17:07.489750 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-60e55196-2adf-459e-b761-82e1683dab4a tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:07.722758 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-60e55196-2adf-459e-b761-82e1683dab4a tempest-VolumesDeleteCascade-847203 None] Create snapshot completed successfully Nov 10 04:17:07.729157 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-615b6d8e-c6c6-4f20-b9b7-e8be164e68db tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['0be1ac77-503e-4f7c-81d1-94aef9acb211', '55632bc1-8fc7-41e1-be0d-f99c0b3baf4c', '1ca4a90e-4155-434e-8cef-c81e9c1a1f51', '4151bd09-fbf6-49b0-b9a5-22a1762fcd27'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:07.817229 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-615b6d8e-c6c6-4f20-b9b7-e8be164e68db tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:17:07.823392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-615b6d8e-c6c6-4f20-b9b7-e8be164e68db tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-eecfa7db-0a13-4179-aee3-afcfc1a57843-delete_snapshot'" released by "delete_snapshot" :: held 1.451s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:08.304932 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-35f95b1e-dc50-44dc-ad8b-147ce3c5b022-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:08.373866 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:08.476491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:08.477501 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] Volume volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:08.490034 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] deleting rbd volume volume-35f95b1e-dc50-44dc-ad8b-147ce3c5b022 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:08.508742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-44fe3e69-09db-4448-8cde-93202ceb3bf4-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:08.554530 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:08.633666 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:08.634636 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-44fe3e69-09db-4448-8cde-93202ceb3bf4 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:08.653000 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-44fe3e69-09db-4448-8cde-93202ceb3bf4 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:08.771325 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6cb89db9-f108-47a8-8497-16f62d69063e tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:08.961762 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] Created reservations ['263d3e5a-6a02-4d8c-9e48-afddb9510912', '6009157d-e4f4-4de7-b3a7-8dea1ff955e1', '0f28a679-60a4-4ba8-a75a-32e9e753e78a', '15cdecb6-851b-4e7e-b2c0-c2dae6180a37'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:09.015789 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:09.055479 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:09.097751 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:09.102176 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] Deleted volume successfully. Nov 10 04:17:09.131192 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ebb4b8d7-216c-42f1-91aa-30895b3e15c5 tempest-VolumesActionsTest-765642991 None] Lock "b'cinder-35f95b1e-dc50-44dc-ad8b-147ce3c5b022-delete_volume'" released by "delete_volume" :: held 0.826s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:09.153826 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['378b89b2-d87b-4ffa-a12b-4df8aecb1732', '50864ee9-0b96-4b8d-99b8-544fd29b52af', '71b99f75-836d-45ba-8dd9-b887b59e5f4e', '9261178b-91f1-45c2-a963-b81da50d79d1'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:09.207181 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:09.238072 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:09.312963 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:09.318014 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:17:09.337443 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3531168c-79d4-4df8-b72c-6b131bace5c4 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-44fe3e69-09db-4448-8cde-93202ceb3bf4-delete_volume'" released by "delete_volume" :: held 0.829s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:09.609080 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-47aad2b9-b81f-486c-9649-6c993380acff tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-6aafd3ba-cba0-4291-8361-a4d8a33281c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:09.610622 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-47aad2b9-b81f-486c-9649-6c993380acff tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:09.881111 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6cb89db9-f108-47a8-8497-16f62d69063e tempest-VolumesDeleteCascade-847203 None] Create snapshot completed successfully Nov 10 04:17:10.031694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:10.043989 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:10.044508 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:10.061372 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (8c948876-2651-4a0a-8c96-4f4e028f9d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:10.064533 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9598fc11-4691-4c1e-bba3-7efa85b8a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:10.073511 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:10.088390 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9598fc11-4691-4c1e-bba3-7efa85b8a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1342866734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac8c622c5e44556b123f0c76f41e8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:10Z,use_quota=True,user_id='5726a431e6ec4dcc90bae2ec9cd07bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:10.091300 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe27a8e1-9578-49e1-84b2-3e5322fdc4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:10.093778 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe27a8e1-9578-49e1-84b2-3e5322fdc4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:10.096363 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d84f4c-242d-4a21-85fc-8e970abaec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:10.099519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d84f4c-242d-4a21-85fc-8e970abaec05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb', 'volume_name': 'volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:10.101314 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ee14f3-e792-4715-aa43-a5dcfb8e31af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:10.104173 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ee14f3-e792-4715-aa43-a5dcfb8e31af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:10.106585 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c1f133-21e4-4a70-8d5f-951f65056c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:10.107376 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Volume 5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb', 'volume_size': 1} Nov 10 04:17:10.107854 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] creating volume 'volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:10.109047 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:10.168589 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:10.169011 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:10.170999 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c1f133-21e4-4a70-8d5f-951f65056c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:10.173139 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c42f59-1853-4521-aa20-541b742a7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:10.182352 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Volume volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb (5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb): created successfully Nov 10 04:17:10.184411 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c42f59-1853-4521-aa20-541b742a7d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:10.188159 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Flow 'volume_create_manager' (8c948876-2651-4a0a-8c96-4f4e028f9d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:10.199649 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4e697f25-b94b-4475-a741-71d54fab6c78 tempest-VolumesActionsTest-39774177 None] Created volume successfully. Nov 10 04:17:10.770104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-47aad2b9-b81f-486c-9649-6c993380acff tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['67404ac5-3fd9-42a1-a7ae-a18b3c91473b', '3c65342e-6acd-49e7-87ca-616eb2c0d963', 'af15bf14-b46e-40e4-af4b-86595951438e', '8afde1de-e4ee-4acc-8253-cb2316224ba9'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:10.841612 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-47aad2b9-b81f-486c-9649-6c993380acff tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:17:10.848010 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-47aad2b9-b81f-486c-9649-6c993380acff tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-6aafd3ba-cba0-4291-8361-a4d8a33281c3-delete_snapshot'" released by "delete_snapshot" :: held 1.240s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:10.972456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Lock "b'cinder-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:11.042696 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Performing cascade delete. {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Nov 10 04:17:11.089297 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Lock "b'cinder-5f437b29-71e9-4095-a64c-d9338081b5d9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:11.110627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:11.652224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Created reservations ['148e8b68-fdb5-4200-8875-251b40a38d67', '025cfd34-28c6-4117-9a24-e1f30480213a', '689aa27f-4799-4906-b222-e833abb4f876', '83b3ea97-d968-425e-8316-606d0e0ca4d2'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:11.765348 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb-delete_volume'" acquired by "delete_volume" :: waited 0.057s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:11.805528 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Delete snapshot completed successfully. Nov 10 04:17:11.829988 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Lock "b'cinder-5f437b29-71e9-4095-a64c-d9338081b5d9-delete_snapshot'" released by "delete_snapshot" :: held 0.741s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:11.889793 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Lock "b'cinder-e08e3a27-44a5-4433-bb41-a570577f9a16-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.059s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:11.896647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:11.977978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:11.978545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] Volume volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:11.989413 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] deleting rbd volume volume-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:12.006049 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.130423 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-b3c1571a-d580-4a0d-b374-f671ae9ae50c-delete_volume'" acquired by "delete_volume" :: waited 0.128s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:12.179638 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.269435 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:12.269919 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:12.281765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-b3c1571a-d580-4a0d-b374-f671ae9ae50c {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:12.431494 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] Created reservations ['4dd715f5-bb74-4353-be4a-8695641fed49', 'a56f8fe7-dd04-495a-a124-ffaec7629744', '0864bd55-d384-4240-a3ab-bddf36a2dbc3', '90c2f9c4-eb8a-4567-ad42-9090350f68cb'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:12.488306 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.521216 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.558440 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:12.571587 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] Deleted volume successfully. Nov 10 04:17:12.587332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9de4eb2c-4cc6-4699-a487-a3ee413176e1 tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-5244ce8f-dbf4-4878-b92f-fd95c8ac7fcb-delete_volume'" released by "delete_volume" :: held 0.829s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:12.608988 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['d9b034b2-283a-43d5-b79b-0d76f36506c8', '7b4df54a-8037-4cda-94bc-a541fe005cb0', 'a7f6d48f-314b-4609-98b3-0ebd2f077903', '401945de-cd05-40b9-b504-f7a2dc414844'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:12.648177 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.672399 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.716663 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:12.721646 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:17:12.736857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-cc182f7f-4b3f-4b88-aee1-49461e247555 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-b3c1571a-d580-4a0d-b374-f671ae9ae50c-delete_volume'" released by "delete_volume" :: held 0.606s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:12.838179 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Created reservations ['d36fa62a-5704-43fc-968e-00635ec70575', 'c7edf48c-ceca-4970-8411-6fcd42eb6bd0', '40c3a179-db0e-43d2-9553-4dbf4a63cc9a', 'f05f3f26-b892-4e57-bfe3-206d38bbd687'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:12.893717 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Delete snapshot completed successfully. Nov 10 04:17:12.909638 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Lock "b'cinder-e08e3a27-44a5-4433-bb41-a570577f9a16-delete_snapshot'" released by "delete_snapshot" :: held 1.020s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:12.917808 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Snapshots deleted, issuing volume delete {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Nov 10 04:17:12.919430 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:12.991015 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:12.994261 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Volume volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:13.013180 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] deleting rbd volume volume-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:13.033906 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:13.081364 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:13.171277 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:13.171787 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] Volume volume-242c1f00-14da-49b7-ab05-57ce44f52845 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:13.185331 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] deleting rbd volume volume-242c1f00-14da-49b7-ab05-57ce44f52845 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:13.401456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Created reservations ['5b3d5717-78c5-4c8b-9416-f29a335bdafe', 'b1d9f4ca-896e-4a70-9c76-45852eb1a644', '179db93e-f96d-4b14-9d87-aee0c1c9f06c', '12339334-fa52-4ace-a51f-129fcab4ba85'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:13.405279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-cc8f2fc1-7de1-401a-a50f-1d869204c0d6-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:13.455709 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:13.516794 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:13.524206 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:13.546598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:13.570030 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:13.597903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:13.604492 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Deleted volume successfully. Nov 10 04:17:13.624571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b19515f1-40d8-4e09-8375-3353af239e15 tempest-VolumesDeleteCascade-847203 None] Lock "b'cinder-fb44a7a7-475a-4d0b-ab3a-2bcbb080e13f-delete_volume'" released by "delete_volume" :: held 2.652s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:13.630703 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] Created reservations ['326dc78d-faba-490f-ab33-4a04de6090c5', '83ecef03-857a-425d-b1ef-cc19496c168d', 'c9be8a0a-5a2d-41ec-8ccf-c333a5acf81b', 'e7107638-f20f-45c5-8de6-8e9966322506'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:13.673145 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:13.697548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:13.721096 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:13.723143 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:17:13.753876 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] deleting parent snapshot volume-cc8f2fc1-7de1-401a-a50f-1d869204c0d6.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:17:14.785543 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] Deleted volume successfully. Nov 10 04:17:14.817406 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9620bc0d-e29c-4bbd-806a-10163e1e1a44 tempest-VolumesActionsTest-39774177 None] Lock "b'cinder-242c1f00-14da-49b7-ab05-57ce44f52845-delete_volume'" released by "delete_volume" :: held 1.783s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:14.849219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['801d54e4-8ddd-492f-a551-096625e99b53', 'f330764e-f45a-44b1-89c3-8e06f0c19741', '821dd0e4-ed83-4a8b-8bee-9fb47e6253f9', 'c1bfea13-0848-484a-981d-394a42ddd1d8'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:14.894947 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:14.929718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:14.964628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:14.968917 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:17:14.988763 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e464567d-6014-421d-89e0-c3245c045643 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-cc8f2fc1-7de1-401a-a50f-1d869204c0d6-delete_volume'" released by "delete_volume" :: held 1.583s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:15.598120 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e224e8f5-bea5-4ab3-b5f8-180bec89b4c0 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-d13be209-8612-4808-95ed-428e85a1de22-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:15.599587 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e224e8f5-bea5-4ab3-b5f8-180bec89b4c0 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:15.889322 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e224e8f5-bea5-4ab3-b5f8-180bec89b4c0 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['084ce29d-3594-4867-9c97-53a794f1cebd', '6ae807fd-92da-4e1d-9c65-e5d62331a94f', '309fc697-d59d-45cd-9ab3-55ea0b91363a', '2ffad376-db6b-4ae5-9f97-de0b11bfeeb7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:15.942248 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e224e8f5-bea5-4ab3-b5f8-180bec89b4c0 tempest-VolumesSnapshotTestJSON-106401922 None] Delete snapshot completed successfully. Nov 10 04:17:15.948974 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e224e8f5-bea5-4ab3-b5f8-180bec89b4c0 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-d13be209-8612-4808-95ed-428e85a1de22-delete_snapshot'" released by "delete_snapshot" :: held 0.351s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:16.732353 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-10e45ab1-9a66-45b6-a400-7c909cbde2b1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:16.773505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:16.863733 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:16.864354 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] Volume volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:16.876077 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] deleting rbd volume volume-10e45ab1-9a66-45b6-a400-7c909cbde2b1 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:17.209233 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] Created reservations ['3062937d-d6a5-4c15-afb4-9afe22c266ba', '4a6b3f93-52b5-4935-9acc-a744d7641ac7', 'b35d3f42-aa31-41f0-b77a-a8d77d9f504f', '97260afb-fac0-46ba-aa65-5375181b6f26'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:17.268657 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:17.310983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:17.381627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:17.393192 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] Deleted volume successfully. Nov 10 04:17:17.408104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1170faf5-e521-41e1-8a75-33a9d3dc21f2 tempest-VolumesSnapshotTestJSON-106401922 None] Lock "b'cinder-10e45ab1-9a66-45b6-a400-7c909cbde2b1-delete_volume'" released by "delete_volume" :: held 0.676s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:18.039205 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:18.045984 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:18.046602 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:18.062327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Flow 'volume_create_manager' (b36ce02b-e5f7-45d3-b8b0-2161b21f32b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:18.066920 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a227412-de77-4d35-83b9-f2d5ce6a8c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.074501 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:18.088808 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a227412-de77-4d35-83b9-f2d5ce6a8c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043317082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=f62c0c9c-425e-4ed1-9aae-d1789cb10607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a98fe29a26f445a84b4c47c9dcee2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:18Z,use_quota=True,user_id='9b1bae462c6a46afbd1608fd32168dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.091883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef26375-c0d6-4ce4-9f9d-8923d0c7242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.094331 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef26375-c0d6-4ce4-9f9d-8923d0c7242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.097270 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8126dd4d-4a70-456f-946d-6284041a9b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.099861 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8126dd4d-4a70-456f-946d-6284041a9b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62c0c9c-425e-4ed1-9aae-d1789cb10607', 'volume_name': 'volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.102180 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8a5cbb-ee98-43f8-bde1-774ce269f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.104881 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8a5cbb-ee98-43f8-bde1-774ce269f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.107008 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b82946-07ea-44d3-8331-3226a292d96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.107780 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Volume f62c0c9c-425e-4ed1-9aae-d1789cb10607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607', 'volume_size': 1} Nov 10 04:17:18.108167 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] creating volume 'volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:18.109405 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:18.182619 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:18.183204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:18.188527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b82946-07ea-44d3-8331-3226a292d96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.194130 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20686d52-7427-4586-9f19-3629457af3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.219437 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Volume volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607 (f62c0c9c-425e-4ed1-9aae-d1789cb10607): created successfully Nov 10 04:17:18.223229 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20686d52-7427-4586-9f19-3629457af3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.229997 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Flow 'volume_create_manager' (b36ce02b-e5f7-45d3-b8b0-2161b21f32b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:18.245009 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9f4eee11-a353-4191-82ab-34a5ff16bef7 tempest-VolumesActionsTest-1833696072 None] Created volume successfully. Nov 10 04:17:18.475005 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:18.482983 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:18.483812 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:18.510332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (972268fb-4bb0-45cc-a16b-6d6f89139c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:18.517859 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74726d50-c6e9-4e4c-be99-9507b9207c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.528214 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:18.555098 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74726d50-c6e9-4e4c-be99-9507b9207c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-218004325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=0caf58bd-274a-4e8c-a3c8-d5e72f627c2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:18Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.563628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bb33c6-0320-4824-8bbb-8d89c74c4998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.567429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bb33c6-0320-4824-8bbb-8d89c74c4998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.574327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa26ce24-f8fe-43e8-9d18-b9f483e8045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.580450 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa26ce24-f8fe-43e8-9d18-b9f483e8045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0caf58bd-274a-4e8c-a3c8-d5e72f627c2f', 'volume_name': 'volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.595279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba0965d-adfe-465a-9fe6-1b5635300553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.597823 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba0965d-adfe-465a-9fe6-1b5635300553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.606195 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8e0080-3252-4793-9a41-c73091d61135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.610469 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Volume 0caf58bd-274a-4e8c-a3c8-d5e72f627c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f', 'volume_size': 1} Nov 10 04:17:18.611441 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] creating volume 'volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:18.614825 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:18.741811 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:18.742432 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:18.745720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8e0080-3252-4793-9a41-c73091d61135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.751331 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3403aca-5439-48b3-abee-804f3a6013e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:18.777821 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Volume volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f (0caf58bd-274a-4e8c-a3c8-d5e72f627c2f): created successfully Nov 10 04:17:18.781227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3403aca-5439-48b3-abee-804f3a6013e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:18.785543 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (972268fb-4bb0-45cc-a16b-6d6f89139c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:18.800273 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6828c67d-31fe-483b-b45e-e84b7835103c tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:20.256960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:20.266384 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:20.267093 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:20.291055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (9f12cbbd-61f9-426f-8190-f0923a401f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:20.294248 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41b3d6c-9814-4d50-a490-a496a7991666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:20.300802 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:20.314987 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41b3d6c-9814-4d50-a490-a496a7991666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1374196456',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=4d89f486-54c6-4471-a2ed-0f7f15e3fd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:20Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:20.318478 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf3ca21-f077-451c-83db-41c94dc2f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:20.328469 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf3ca21-f077-451c-83db-41c94dc2f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:20.335062 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1651e811-967f-4cdb-b454-e213651455bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:20.338799 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1651e811-967f-4cdb-b454-e213651455bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d89f486-54c6-4471-a2ed-0f7f15e3fd6e', 'volume_name': 'volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:20.341267 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5505d39-6fc7-43cb-8e64-dae847def493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:20.343694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5505d39-6fc7-43cb-8e64-dae847def493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:20.347983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9c746d-521e-40dd-a180-de6ef87dc59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:20.348837 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Volume 4d89f486-54c6-4471-a2ed-0f7f15e3fd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e', 'volume_size': 1} Nov 10 04:17:20.349239 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] creating volume 'volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:20.350262 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:20.458475 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:20.459214 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:20.461405 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9c746d-521e-40dd-a180-de6ef87dc59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:20.463787 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f733b5-3158-4366-a525-ea44a0376ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:20.481579 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Volume volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e (4d89f486-54c6-4471-a2ed-0f7f15e3fd6e): created successfully Nov 10 04:17:20.485714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f733b5-3158-4366-a525-ea44a0376ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:20.498396 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (9f12cbbd-61f9-426f-8190-f0923a401f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:20.525831 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-01d88616-3cb0-4f72-b114-3f9428638227 tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:21.373840 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:21.386366 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:21.387736 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:21.407354 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Flow 'volume_create_manager' (44913acc-57ba-4437-825a-cd89fe08a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:21.420987 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b30a241-cb71-4078-b5b2-81e9811e22b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:21.432415 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:21.474528 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b30a241-cb71-4078-b5b2-81e9811e22b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-977277463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b123e788-88b4-4b4f-8dcf-9063823ce34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02273f07cda641aeb603060c95be43a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:21Z,use_quota=True,user_id='0e657e3ab6d5440db8f81d6b0ed7c056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:21.484460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59adf612-fb06-4e87-b69a-714ddcba3c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:21.489954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59adf612-fb06-4e87-b69a-714ddcba3c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:21.499052 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b503f2-b9b8-41ed-94d4-68151611dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:21.501601 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b503f2-b9b8-41ed-94d4-68151611dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b123e788-88b4-4b4f-8dcf-9063823ce34e', 'volume_name': 'volume-b123e788-88b4-4b4f-8dcf-9063823ce34e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:21.504910 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a174cb2-522b-404f-8c03-2ae2480681ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:21.522856 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a174cb2-522b-404f-8c03-2ae2480681ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:21.526970 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d9adb1-a91d-4021-a697-c79d1a2133e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:21.528062 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Volume b123e788-88b4-4b4f-8dcf-9063823ce34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b123e788-88b4-4b4f-8dcf-9063823ce34e', 'volume_size': 1} Nov 10 04:17:21.529233 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] creating volume 'volume-b123e788-88b4-4b4f-8dcf-9063823ce34e' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:21.530609 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:21.571477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e-delete_volume'" acquired by "delete_volume" :: waited 0.117s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:21.606995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:21.675955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:21.676379 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] Volume volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:21.685492 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:21.697170 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:21.701954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:21.705627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d9adb1-a91d-4021-a697-c79d1a2133e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b123e788-88b4-4b4f-8dcf-9063823ce34e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:21.713331 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbc0515-a1df-4ff7-a9e2-22b9610ed665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:21.726650 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Volume volume-b123e788-88b4-4b4f-8dcf-9063823ce34e (b123e788-88b4-4b4f-8dcf-9063823ce34e): created successfully Nov 10 04:17:21.732597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbc0515-a1df-4ff7-a9e2-22b9610ed665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:21.735518 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Flow 'volume_create_manager' (44913acc-57ba-4437-825a-cd89fe08a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:21.757610 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7241f6d5-c965-448c-8025-9163baa98e5a tempest-VolumesSnapshotListTestJSON-549605144 None] Created volume successfully. Nov 10 04:17:22.029545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] Created reservations ['2c5fa5e5-5a21-4cab-9827-4f98f3ac079c', 'f2e951cf-256a-4ab9-b3fe-e9b77f98a7b9', '0f5ff082-9045-43c7-8baf-fef35847ce0b', '64f6f9a7-f1eb-44c5-a50c-ef5602403964'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:22.079251 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:22.115396 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:22.185159 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:22.191688 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:22.212699 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-03704cc0-c0ce-4ea2-a43c-717a636c51a6 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-4d89f486-54c6-4471-a2ed-0f7f15e3fd6e-delete_volume'" released by "delete_volume" :: held 0.641s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:22.565010 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3c9a38a2-f29e-44ee-ad3d-5ba0c858e515 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:22.638200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:22.685907 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:22.739511 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:22.740086 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] Volume volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:22.747795 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:23.094700 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] Created reservations ['7a6cb5cb-6fc6-4ca4-96c2-68201b4ca92f', '9806c559-fce7-4bf3-a8b1-e1b1649eb501', '5522de6f-f705-4707-b485-4397b57312f7', '3f82c012-c337-4c5f-a405-a26795e5f136'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:23.159785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:23.213057 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:23.279014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:23.289449 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:23.334043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3dfc942c-384e-4e45-bc0a-8c1edb169bb7 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-0caf58bd-274a-4e8c-a3c8-d5e72f627c2f-delete_volume'" released by "delete_volume" :: held 0.696s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:23.683142 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3c9a38a2-f29e-44ee-ad3d-5ba0c858e515 tempest-VolumesSnapshotListTestJSON-549605144 None] Create snapshot completed successfully Nov 10 04:17:24.204824 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:24.218505 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:24.219932 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:24.238572 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (5d64e06b-118a-4435-904b-6e35658c4b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:24.241983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d144945-f37c-420c-b6c5-d98ade458362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:24.249813 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:24.263225 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d144945-f37c-420c-b6c5-d98ade458362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1209179605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=e8d6b154-c0dd-4fb4-8635-bdf9c466d99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:24Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:24.265854 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2acef1-f883-427f-8812-070b47de94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:24.268204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2acef1-f883-427f-8812-070b47de94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:24.270599 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3428e4e1-4db1-4331-b073-33ac2e86e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:24.272834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3428e4e1-4db1-4331-b073-33ac2e86e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'volume_name': 'volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:24.275671 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c844c8e-fe1e-408a-9baa-13812d78293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:24.277826 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c844c8e-fe1e-408a-9baa-13812d78293b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:24.279992 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18582dbc-581c-4916-b0ec-8b0e1412fd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:24.280797 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Volume e8d6b154-c0dd-4fb4-8635-bdf9c466d99f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'volume_size': 1} Nov 10 04:17:24.281196 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] creating volume 'volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:24.282191 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:24.390561 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:24.390944 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:24.392985 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18582dbc-581c-4916-b0ec-8b0e1412fd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:24.395426 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa92360-6ed1-496c-a6ee-0471a8f8942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:24.410686 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Volume volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f (e8d6b154-c0dd-4fb4-8635-bdf9c466d99f): created successfully Nov 10 04:17:24.413978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa92360-6ed1-496c-a6ee-0471a8f8942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:24.418048 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (5d64e06b-118a-4435-904b-6e35658c4b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:24.428295 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-94588fc8-219c-40ad-aa52-df385e3e9ed1 tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:24.969327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f870f08f-6c35-45b8-b19c-ed138fd0a6f4 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:25.546044 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:25.549241 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:25.549687 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:25.569935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (e32582d4-53be-441d-9655-d554cce7ec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:25.573425 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e446ea06-8285-4ec7-b33c-3f00603fda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:25.579642 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:25.592227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e446ea06-8285-4ec7-b33c-3f00603fda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-265386568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=2d194e8b-f3a2-45a2-b5bf-ea527f978e1f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e8d6b154-c0dd-4fb4-8635-bdf9c466d99f,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:26Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:25.594774 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76bd34e-b7f2-4946-a6c0-3247b79f309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:25.596972 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76bd34e-b7f2-4946-a6c0-3247b79f309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:25.599311 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9144729-2f70-4317-a39a-78f527a20d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:25.612447 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9144729-2f70-4317-a39a-78f527a20d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d194e8b-f3a2-45a2-b5bf-ea527f978e1f', 'volume_name': 'volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f', 'volume_size': 1, 'source_volid': 'e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'source_volstatus': 'available'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:25.614995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b43e46-a027-4d78-8010-340c139aa2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:25.617130 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b43e46-a027-4d78-8010-340c139aa2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:25.619601 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047561ff-6301-42e9-907d-0b24ca33043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:25.620372 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Volume 2d194e8b-f3a2-45a2-b5bf-ea527f978e1f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f', 'volume_size': 1, 'source_volid': 'e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'source_volstatus': 'available'} Nov 10 04:17:25.634452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:25.673612 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] creating snapshot='volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:17:26.693638 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] cloning 'volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f@volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f.clone_snap' to 'volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:17:26.759546 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f870f08f-6c35-45b8-b19c-ed138fd0a6f4 tempest-VolumesSnapshotListTestJSON-549605144 None] Create snapshot completed successfully Nov 10 04:17:26.815080 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Volume volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:26.816765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:26.816955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:26.861202 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:17:26.863257 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047561ff-6301-42e9-907d-0b24ca33043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f', 'volume_size': 1, 'source_volid': 'e8d6b154-c0dd-4fb4-8635-bdf9c466d99f', 'source_volstatus': 'available'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:26.865420 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f77f35-8db0-4fee-aa82-ad26229a576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:26.883612 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Volume volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f (2d194e8b-f3a2-45a2-b5bf-ea527f978e1f): created successfully Nov 10 04:17:26.885592 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f77f35-8db0-4fee-aa82-ad26229a576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:26.888466 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (e32582d4-53be-441d-9655-d554cce7ec6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:26.902899 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:26.906872 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:26.907311 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:26.919348 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Flow 'volume_create_manager' (0eb001a5-b636-4678-b0ab-80728c04e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:26.922387 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb2a353-efb0-4ced-9ee3-d22bbc5c2f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:26.928704 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e4086a04-eb52-48dc-a5d4-83086b70f048 tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:26.932514 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:26.946926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb2a353-efb0-4ced-9ee3-d22bbc5c2f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1441656585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=24e94d61-d44f-42f6-9758-672401cefbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e88284f9ef743c7bd4c0df26719a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:27Z,use_quota=True,user_id='45ec13d633804480abc8eb86e9f072cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:26.949463 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9463a7eb-a8a3-439d-9649-e61ec21578a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:26.951579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9463a7eb-a8a3-439d-9649-e61ec21578a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:26.954364 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110880a5-90ad-4ba6-9077-b9353a5b1a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:26.956447 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110880a5-90ad-4ba6-9077-b9353a5b1a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e94d61-d44f-42f6-9758-672401cefbb8', 'volume_name': 'volume-24e94d61-d44f-42f6-9758-672401cefbb8', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:26.958708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a23744-cb76-4c39-ace8-f2d270f3c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:26.960827 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a23744-cb76-4c39-ace8-f2d270f3c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:26.963012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dbfdc6-4cc1-4420-9311-5797170e3355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:26.963785 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Volume 24e94d61-d44f-42f6-9758-672401cefbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e94d61-d44f-42f6-9758-672401cefbb8', 'volume_size': 1} Nov 10 04:17:26.964172 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] creating volume 'volume-24e94d61-d44f-42f6-9758-672401cefbb8' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:26.965207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:27.033427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:27.033807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:27.036344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dbfdc6-4cc1-4420-9311-5797170e3355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e94d61-d44f-42f6-9758-672401cefbb8', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:27.039289 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922c7487-3019-446a-85d9-69f5f6805edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:27.048781 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Volume volume-24e94d61-d44f-42f6-9758-672401cefbb8 (24e94d61-d44f-42f6-9758-672401cefbb8): created successfully Nov 10 04:17:27.050758 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922c7487-3019-446a-85d9-69f5f6805edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:27.053608 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Flow 'volume_create_manager' (0eb001a5-b636-4678-b0ab-80728c04e210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:27.062412 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9fdb3752-59c6-4142-bd75-fed5b4e04765 tempest-ServersNegativeTestJSON-928906600 None] Created volume successfully. Nov 10 04:17:27.176782 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cbe93f92-061d-490c-aeb5-415216cbb29a tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:27.780208 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cbe93f92-061d-490c-aeb5-415216cbb29a tempest-VolumesSnapshotListTestJSON-549605144 None] Create snapshot completed successfully Nov 10 04:17:28.179687 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:28.190006 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:28.190959 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:28.208561 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (b8e237c8-7849-4df3-9ef5-820317266859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:28.212598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efb5c03-b67a-4737-8660-9ddc66bb22e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:28.221818 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:28.241871 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efb5c03-b67a-4737-8660-9ddc66bb22e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1383630600',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=7e0b86de-8936-4a6b-b3fc-9ad684f76a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:28Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:28.245476 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a451a24c-e4f9-4d84-aeea-af579355404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:28.248636 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a451a24c-e4f9-4d84-aeea-af579355404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:28.257217 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e5aa6e-e4a5-4ca9-888e-05b77a06bbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:28.260738 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e5aa6e-e4a5-4ca9-888e-05b77a06bbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0b86de-8936-4a6b-b3fc-9ad684f76a7a', 'volume_name': 'volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:28.264846 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947183eb-20e0-4f52-a976-3c0ba13bb5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:28.267267 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947183eb-20e0-4f52-a976-3c0ba13bb5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:28.271149 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2cd4ee-123d-4e2f-8ab8-456366e5a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:28.272152 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Volume 7e0b86de-8936-4a6b-b3fc-9ad684f76a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a', 'volume_size': 1} Nov 10 04:17:28.272892 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] creating volume 'volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:28.274889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:28.361125 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:28.361694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:28.365679 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2cd4ee-123d-4e2f-8ab8-456366e5a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:28.367924 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49946861-ce62-4dc2-a21e-76c3280e212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:28.379218 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Volume volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a (7e0b86de-8936-4a6b-b3fc-9ad684f76a7a): created successfully Nov 10 04:17:28.401341 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49946861-ce62-4dc2-a21e-76c3280e212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:28.406480 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (b8e237c8-7849-4df3-9ef5-820317266859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:28.419867 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-be8e9891-9729-4ee3-81a6-6c59b0d8efac tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:28.545809 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:17:28.546922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:28.581404 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:28.644326 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:29.012529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:29.016404 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:29.016785 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:29.037413 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Flow 'volume_create_manager' (c320a3d3-ff68-4565-a185-d445bfd86c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:29.041542 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfa5518-83c1-479d-b6d0-8e95bc9b6589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:29.047891 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:29.061580 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfa5518-83c1-479d-b6d0-8e95bc9b6589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1607130813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=62edb6ae-a3c5-4664-a62a-5a6e328168d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e88284f9ef743c7bd4c0df26719a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:29Z,use_quota=True,user_id='45ec13d633804480abc8eb86e9f072cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:29.064054 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdce633-8262-4f39-8b08-389a8b5104d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:29.066521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdce633-8262-4f39-8b08-389a8b5104d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:29.069580 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aed441-ad06-4ed9-bc72-f2ce7cfffead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:29.072884 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aed441-ad06-4ed9-bc72-f2ce7cfffead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62edb6ae-a3c5-4664-a62a-5a6e328168d5', 'volume_name': 'volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:29.077688 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b13bae-2589-44ad-8b7d-2f59c98ca633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:29.080482 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b13bae-2589-44ad-8b7d-2f59c98ca633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:29.084405 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4cb379-1a29-46f7-a0db-f3b48c19010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:29.086895 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Volume 62edb6ae-a3c5-4664-a62a-5a6e328168d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5', 'volume_size': 1} Nov 10 04:17:29.087464 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] creating volume 'volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:29.088952 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:29.145935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-852bbca3-5480-4de5-a051-b14aea81da11 tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-2d174e96-c18d-4f55-9751-80e08543b1da-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:29.147357 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-852bbca3-5480-4de5-a051-b14aea81da11 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:29.193720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:29.194198 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:29.196858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4cb379-1a29-46f7-a0db-f3b48c19010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:29.199406 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1a3592-214a-4ef5-bddf-707d82384271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:29.211507 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Volume volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5 (62edb6ae-a3c5-4664-a62a-5a6e328168d5): created successfully Nov 10 04:17:29.213557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1a3592-214a-4ef5-bddf-707d82384271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:29.216387 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Flow 'volume_create_manager' (c320a3d3-ff68-4565-a185-d445bfd86c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:29.228107 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-dde5269f-cdc0-49a2-a845-a8ac4fa8eaaa tempest-ServersNegativeTestJSON-928906600 None] Created volume successfully. Nov 10 04:17:29.293977 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:29.326962 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:29.364295 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:29.364752 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] Volume volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:29.369633 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:29.561610 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] Created reservations ['0c8c3521-1149-44f1-bd56-016532463f28', 'fc6bb5ce-fb99-4987-a163-f9ea24ffa652', 'b43e1bb6-76f6-4dcd-8e40-548f0f85d3f6', '7a6de0d4-6bf9-4c8b-ab61-ee9be8ff5ed3'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:29.601061 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:29.623811 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:29.646318 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:29.650688 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:29.662264 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ccb407c8-e3e8-42cf-897c-bb2fedeacb27 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-7e0b86de-8936-4a6b-b3fc-9ad684f76a7a-delete_volume'" released by "delete_volume" :: held 0.369s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:29.778629 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-852bbca3-5480-4de5-a051-b14aea81da11 tempest-VolumesSnapshotListTestJSON-549605144 None] Created reservations ['5296d9bd-264a-4ba1-a301-cf2c504b6f0a', 'e9006b01-eaf2-4f81-afd6-bbda692b2f4e', 'f8924b2c-6d90-49e5-8c1c-93e87e6d81c5', 'abfd3d8f-e10b-42f5-89a3-93fc20decf20'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:29.811119 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-852bbca3-5480-4de5-a051-b14aea81da11 tempest-VolumesSnapshotListTestJSON-549605144 None] Delete snapshot completed successfully. Nov 10 04:17:29.815841 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-852bbca3-5480-4de5-a051-b14aea81da11 tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-2d174e96-c18d-4f55-9751-80e08543b1da-delete_snapshot'" released by "delete_snapshot" :: held 0.670s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:30.222958 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-d853953f-fdbf-43b0-8c7b-00fb297426f2 tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-22eb6292-b7fd-4bc1-ac47-0f0281c48415-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:30.225795 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d853953f-fdbf-43b0-8c7b-00fb297426f2 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:30.443834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-97b5c9b5-ae36-4349-a318-34c7eaa2f577 tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607'" acquired by "attach_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:30.485201 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:30.529695 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-97b5c9b5-ae36-4349-a318-34c7eaa2f577 tempest-VolumesActionsTest-1833696072 None] Attaching volume f62c0c9c-425e-4ed1-9aae-d1789cb10607 to instance e8d4107b-833c-4921-b1c2-b6f1ffce5466 at mountpoint /dev/sdb on host None. Nov 10 04:17:30.543023 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:30.607129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:30.620287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:30.637848 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-97b5c9b5-ae36-4349-a318-34c7eaa2f577 tempest-VolumesActionsTest-1833696072 None] Attach volume completed successfully. Nov 10 04:17:30.643821 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-97b5c9b5-ae36-4349-a318-34c7eaa2f577 tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607'" released by "attach_volume" :: held 0.200s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:30.804675 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7e67c00d-dd97-4425-a703-c76ad1e6c3a0 tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:30.804675 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7e67c00d-dd97-4425-a703-c76ad1e6c3a0 tempest-VolumesActionsTest-1833696072 None] Detaching volume f62c0c9c-425e-4ed1-9aae-d1789cb10607 from instance e8d4107b-833c-4921-b1c2-b6f1ffce5466. Nov 10 04:17:30.898188 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7e67c00d-dd97-4425-a703-c76ad1e6c3a0 tempest-VolumesActionsTest-1833696072 None] Detach volume completed successfully. Nov 10 04:17:30.907582 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7e67c00d-dd97-4425-a703-c76ad1e6c3a0 tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607-detach_volume'" released by "detach_volume" :: held 0.103s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:30.916519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-d853953f-fdbf-43b0-8c7b-00fb297426f2 tempest-VolumesSnapshotListTestJSON-549605144 None] Created reservations ['b95b1b93-2dda-4c6e-b3cc-cd230aacc84c', '67122152-00da-4cc2-ae62-ebb9ef2ff89a', 'a2555c06-c538-4e10-8426-88a4c49f8d32', '085c2212-5d61-4398-84a7-67b923860c5b'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:30.971485 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d853953f-fdbf-43b0-8c7b-00fb297426f2 tempest-VolumesSnapshotListTestJSON-549605144 None] Delete snapshot completed successfully. Nov 10 04:17:30.978894 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-d853953f-fdbf-43b0-8c7b-00fb297426f2 tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-22eb6292-b7fd-4bc1-ac47-0f0281c48415-delete_snapshot'" released by "delete_snapshot" :: held 0.756s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:30.995807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:17:31.017090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] Volume volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:31.017788 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] deleting parent snapshot volume-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:17:31.833896 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3fbc8593-fedc-41df-884c-2bff03bbb0bd tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-8591e323-8b0a-45c1-b1a4-f7fbbcce7534-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:31.835560 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbc8593-fedc-41df-884c-2bff03bbb0bd tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:31.905466 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] Created reservations ['b84f4195-b4f6-4b3a-80b2-9178f3464460', '5c047e7e-ef8d-4166-9045-e0f3a5530b03', 'b7ceb6cd-1234-4516-b857-b8cd2d76d293', '6719af6f-5a93-48ae-b829-b445c4a4c378'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:31.954661 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:31.989060 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:32.023557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:32.030656 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:32.046269 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-030e3d55-37a0-45f6-a755-951f250ffbe9 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-2d194e8b-f3a2-45a2-b5bf-ea527f978e1f-delete_volume'" released by "delete_volume" :: held 1.561s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:32.935417 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3fbc8593-fedc-41df-884c-2bff03bbb0bd tempest-VolumesSnapshotListTestJSON-549605144 None] Created reservations ['3cbed933-c82d-4e8c-a32c-63ae40c313dd', 'cc945897-2e5f-4ad8-8dcf-87aa325272a9', '10e21d69-d2ab-4501-b2ba-1dfd9b5119bf', 'e324246b-91c4-45f9-aaec-620d7687e4d1'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:33.010105 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3fbc8593-fedc-41df-884c-2bff03bbb0bd tempest-VolumesSnapshotListTestJSON-549605144 None] Delete snapshot completed successfully. Nov 10 04:17:33.016371 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3fbc8593-fedc-41df-884c-2bff03bbb0bd tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-8591e323-8b0a-45c1-b1a4-f7fbbcce7534-delete_snapshot'" released by "delete_snapshot" :: held 1.182s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:33.199366 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:33.203819 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:33.204260 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:33.216656 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (b43ba509-a55c-4bfd-af52-5809ca361b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:33.219742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d341ce2-f93b-4965-9145-61a43f7b0447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:33.228645 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:33.245499 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d341ce2-f93b-4965-9145-61a43f7b0447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2113427771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=18d406b8-8bba-4fec-968a-6c1df30da1f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:33Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:33.248094 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0446e560-3d80-49b7-9ac6-485b7485e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:33.250254 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0446e560-3d80-49b7-9ac6-485b7485e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:33.252579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10b1bc2-5ed8-488e-9bfe-ef823336cd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:33.340409 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10b1bc2-5ed8-488e-9bfe-ef823336cd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18d406b8-8bba-4fec-968a-6c1df30da1f0', 'volume_name': 'volume-18d406b8-8bba-4fec-968a-6c1df30da1f0', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:33.343024 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c56e869-6a35-4049-b415-5e5121e69996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:33.345373 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c56e869-6a35-4049-b415-5e5121e69996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:33.347558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea131c1-ee18-4f92-8213-454e7471e54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:33.348484 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Volume 18d406b8-8bba-4fec-968a-6c1df30da1f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18d406b8-8bba-4fec-968a-6c1df30da1f0', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:17:33.349086 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Cloning 18d406b8-8bba-4fec-968a-6c1df30da1f0 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:17:33.358690 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:33.367946 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 17, 33, 362679)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:17:33.368430 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:17:33.368864 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:17:33.373346 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:33.374283 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:17:33.381038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 17, 33, 378152)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:17:33.382052 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:17:33.382852 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:17:33.398546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:33.478679 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] creating snapshot='volume-18d406b8-8bba-4fec-968a-6c1df30da1f0.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:17:33.834286 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-18d406b8-8bba-4fec-968a-6c1df30da1f0.clone_snap' to 'volume-18d406b8-8bba-4fec-968a-6c1df30da1f0' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:17:33.856650 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-b123e788-88b4-4b4f-8dcf-9063823ce34e-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:33.913932 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:34.001564 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:34.002204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] Volume volume-b123e788-88b4-4b4f-8dcf-9063823ce34e is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:34.010288 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] deleting rbd volume volume-b123e788-88b4-4b4f-8dcf-9063823ce34e {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:34.062337 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:34.064344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:34.064820 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:34.094426 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:17:34.095402 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Marking volume 18d406b8-8bba-4fec-968a-6c1df30da1f0 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:17:34.107392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 18d406b8-8bba-4fec-968a-6c1df30da1f0. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:17:34.108093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Creating volume glance metadata for volume 18d406b8-8bba-4fec-968a-6c1df30da1f0 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:17:34.190112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea131c1-ee18-4f92-8213-454e7471e54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d406b8-8bba-4fec-968a-6c1df30da1f0', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:34.196909 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b8fba3-d3da-4b20-8a08-126c05935e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:34.211779 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Volume volume-18d406b8-8bba-4fec-968a-6c1df30da1f0 (18d406b8-8bba-4fec-968a-6c1df30da1f0): created successfully Nov 10 04:17:34.216090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b8fba3-d3da-4b20-8a08-126c05935e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:34.219496 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (b43ba509-a55c-4bfd-af52-5809ca361b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:34.230730 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1f56375d-bf6f-4831-9708-3b9a6bceed41 tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:34.317972 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] Created reservations ['00deaf16-5d03-4b2b-93fc-4e7efa5a396a', '5350fe37-0310-4d20-87f2-387e47493ebe', '2a0240b5-2ef0-49e4-8627-5d1445e2d3d4', '546924d3-1c0d-4225-962a-4480978e8d0c'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:34.380823 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:34.435330 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:34.482826 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:34.488010 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] Deleted volume successfully. Nov 10 04:17:34.501600 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9f0c48f1-1dc6-483f-96bd-d1bb32e9afc6 tempest-VolumesSnapshotListTestJSON-549605144 None] Lock "b'cinder-b123e788-88b4-4b4f-8dcf-9063823ce34e-delete_volume'" released by "delete_volume" :: held 0.645s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:35.992298 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:35.999028 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:35.999654 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:36.016815 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (99b6fc72-1171-4829-8312-8d2a1bcc90ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:36.021044 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81355994-f48c-4aa5-804c-e96a187473d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:36.029685 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:36.048439 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81355994-f48c-4aa5-804c-e96a187473d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2026364826',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=c8b74259-9840-41ea-aac4-ecff893ecf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7d32d780ea4a4c8ea311bc0477cc1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:36Z,use_quota=True,user_id='ab4061e5aca2462e8d0bd2898c345f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:36.051436 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cda2329-5c2f-45db-8729-8ba1233ad3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:36.054556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cda2329-5c2f-45db-8729-8ba1233ad3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:36.056980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5545a396-b5fd-4cd1-b679-4d4d8e6bc6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:36.059619 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5545a396-b5fd-4cd1-b679-4d4d8e6bc6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b74259-9840-41ea-aac4-ecff893ecf1b', 'volume_name': 'volume-c8b74259-9840-41ea-aac4-ecff893ecf1b', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:36.062461 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef461670-13a7-4620-afe9-cb3859890490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:36.064646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef461670-13a7-4620-afe9-cb3859890490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:36.067208 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea8509f-9a91-4b1b-806e-25a3f48cc8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:36.068080 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Volume c8b74259-9840-41ea-aac4-ecff893ecf1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b74259-9840-41ea-aac4-ecff893ecf1b', 'volume_size': 1} Nov 10 04:17:36.068509 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] creating volume 'volume-c8b74259-9840-41ea-aac4-ecff893ecf1b' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:36.069922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:36.184752 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:36.185136 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:36.187529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea8509f-9a91-4b1b-806e-25a3f48cc8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b74259-9840-41ea-aac4-ecff893ecf1b', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:36.189689 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31041f8d-b4c7-4d39-854f-e41681ed3b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:36.204312 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Volume volume-c8b74259-9840-41ea-aac4-ecff893ecf1b (c8b74259-9840-41ea-aac4-ecff893ecf1b): created successfully Nov 10 04:17:36.206844 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31041f8d-b4c7-4d39-854f-e41681ed3b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:36.211919 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Flow 'volume_create_manager' (99b6fc72-1171-4829-8312-8d2a1bcc90ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:36.232476 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ab8d6134-1f79-47fb-b834-57fae9159596 tempest-VolumesGetTest-2114835360 None] Created volume successfully. Nov 10 04:17:37.204786 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-c8b74259-9840-41ea-aac4-ecff893ecf1b-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:37.317993 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:37.400784 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:37.401240 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] Volume volume-c8b74259-9840-41ea-aac4-ecff893ecf1b is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:37.408949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-c8b74259-9840-41ea-aac4-ecff893ecf1b {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:37.666107 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:37.682031 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:37.683061 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:37.714754 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Flow 'volume_create_manager' (26211634-cd50-4853-bc96-bcaa27795086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:37.724759 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bc743e-a618-4022-9cf6-e7165ddda1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:37.743162 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:37.793548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6bc743e-a618-4022-9cf6-e7165ddda1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-13451151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=7d20e82a-774c-445b-a4ea-103f5a2cde44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a2ec0afddf403183d9d44778510b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:38Z,use_quota=True,user_id='694bd6d882cd4099b51d58a50f6f1ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:37.805329 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41dd9bb-a181-4ea7-ae72-88a58f320a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:37.810088 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41dd9bb-a181-4ea7-ae72-88a58f320a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:37.813600 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9816eb8-7e26-49c1-bc41-0c064d408d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:37.820519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9816eb8-7e26-49c1-bc41-0c064d408d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d20e82a-774c-445b-a4ea-103f5a2cde44', 'volume_name': 'volume-7d20e82a-774c-445b-a4ea-103f5a2cde44', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:37.824058 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab7f9c-32ad-43dd-ab08-b9bc1d66ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:37.838380 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab7f9c-32ad-43dd-ab08-b9bc1d66ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:37.854176 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0f4fb-967b-4054-9303-751dd363edfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:37.854997 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Volume 7d20e82a-774c-445b-a4ea-103f5a2cde44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d20e82a-774c-445b-a4ea-103f5a2cde44', 'volume_size': 1} Nov 10 04:17:37.855392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] creating volume 'volume-7d20e82a-774c-445b-a4ea-103f5a2cde44' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:37.856428 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:37.976029 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] Created reservations ['f5607c8d-9a5a-40b9-bd08-2cf6a569352f', '362d7b3d-53ec-41a2-aa85-c2ca384d7b71', 'f2aaca48-73f5-4e16-9571-a7894b9eb2fa', 'd8300757-e152-494b-bec1-b897128fd308'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:37.999527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:37.999923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:38.002090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0f4fb-967b-4054-9303-751dd363edfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d20e82a-774c-445b-a4ea-103f5a2cde44', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:38.004856 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e08c33d-55ca-40d4-af34-3334a0fc7c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:38.030718 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Volume volume-7d20e82a-774c-445b-a4ea-103f5a2cde44 (7d20e82a-774c-445b-a4ea-103f5a2cde44): created successfully Nov 10 04:17:38.034093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e08c33d-55ca-40d4-af34-3334a0fc7c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:38.038112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Flow 'volume_create_manager' (26211634-cd50-4853-bc96-bcaa27795086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:38.058273 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-84acd0b4-191f-4143-b3b5-ff690ed17780 tempest-AttachVolumeTestJSON-389116424 None] Created volume successfully. Nov 10 04:17:38.062545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:38.117424 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:38.178234 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:38.185959 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:38.216020 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3b77de79-0f47-45c8-928c-f0da6b5a43b6 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-c8b74259-9840-41ea-aac4-ecff893ecf1b-delete_volume'" released by "delete_volume" :: held 1.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:38.385685 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-18d406b8-8bba-4fec-968a-6c1df30da1f0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:38.451490 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:38.574608 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:38.601357 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-18d406b8-8bba-4fec-968a-6c1df30da1f0 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:39.043633 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:17:39.101444 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] deleting parent snapshot volume-18d406b8-8bba-4fec-968a-6c1df30da1f0.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:17:39.739097 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-53350f05-8ad9-430d-b0c2-89ec743c068c req-f7b0cf94-ce89-4a7c-b3ea-ca83ec1012a7 tempest-AttachVolumeTestJSON-389116424 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:17:39.843087 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] Created reservations ['f50eb441-ffb8-4a51-810d-cdb35c34b5cb', '3db904bd-e187-4efa-a691-ecd14d69396e', '76165282-cac5-44c2-a514-6b4e8e89d8be', '40d2c54e-c35f-44cf-88d7-995e7b7da30e'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:39.914061 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:39.978779 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:40.037396 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:40.048502 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:40.073531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7f7a2243-4e92-4c56-993a-7d0ec55308b9 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-18d406b8-8bba-4fec-968a-6c1df30da1f0-delete_volume'" released by "delete_volume" :: held 1.688s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:40.568774 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-53350f05-8ad9-430d-b0c2-89ec743c068c req-f7b0cf94-ce89-4a7c-b3ea-ca83ec1012a7 tempest-AttachVolumeTestJSON-389116424 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.830s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:17:40.572416 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-53350f05-8ad9-430d-b0c2-89ec743c068c req-f7b0cf94-ce89-4a7c-b3ea-ca83ec1012a7 tempest-AttachVolumeTestJSON-389116424 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7d20e82a-774c-445b-a4ea-103f5a2cde44', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '7d20e82a-774c-445b-a4ea-103f5a2cde44', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:17:40.631874 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-53350f05-8ad9-430d-b0c2-89ec743c068c req-f7b0cf94-ce89-4a7c-b3ea-ca83ec1012a7 tempest-AttachVolumeTestJSON-389116424 None] Connection info returned from driver {'name': 'volumes/volume-7d20e82a-774c-445b-a4ea-103f5a2cde44', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7d20e82a-774c-445b-a4ea-103f5a2cde44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94143a5d-bce8-4bb2-b428-77b12ea20758'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:17:40.723671 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-53350f05-8ad9-430d-b0c2-89ec743c068c req-f7b0cf94-ce89-4a7c-b3ea-ca83ec1012a7 tempest-AttachVolumeTestJSON-389116424 None] attachment_update completed successfully. Nov 10 04:17:40.777109 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:40.871673 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:40.967800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:17:40.968718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] Volume volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:17:40.989713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] deleting rbd volume volume-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:17:41.415764 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] Created reservations ['9b6fa5df-bc01-4aa9-b3c0-304fbf1954ac', '9e4299c8-bde8-46ce-b29d-075ce80b6e70', '313e1b4e-aa1b-42eb-abfd-089bb2e18726', 'b8421a7f-89f2-488b-84d2-ac3175ea74ee'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:17:41.478790 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:41.564089 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:41.630729 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:17:41.635781 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] Deleted volume successfully. Nov 10 04:17:41.662551 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-83e0df71-6d28-43eb-b3d3-64acc6527841 tempest-VolumesGetTest-2114835360 None] Lock "b'cinder-e8d6b154-c0dd-4fb4-8635-bdf9c466d99f-delete_volume'" released by "delete_volume" :: held 0.886s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:51.996109 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-aa7d0748-ed57-4853-a86e-ee910a6bd2cc tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607'" acquired by "attach_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:52.137886 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-aa7d0748-ed57-4853-a86e-ee910a6bd2cc tempest-VolumesActionsTest-1833696072 None] Attaching volume f62c0c9c-425e-4ed1-9aae-d1789cb10607 to instance 24485f47-6c01-4ebd-8d73-480885b4aa7c at mountpoint /dev/sdb on host None. Nov 10 04:17:52.191991 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-aa7d0748-ed57-4853-a86e-ee910a6bd2cc tempest-VolumesActionsTest-1833696072 None] Attach volume completed successfully. Nov 10 04:17:52.198779 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-aa7d0748-ed57-4853-a86e-ee910a6bd2cc tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607'" released by "attach_volume" :: held 0.202s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:52.544092 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5cac8274-bbb7-41f9-962b-e3fa4df8ffd3 tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607-detach_volume'" acquired by "detach_volume" :: waited 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:17:52.546310 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5cac8274-bbb7-41f9-962b-e3fa4df8ffd3 tempest-VolumesActionsTest-1833696072 None] Detaching volume f62c0c9c-425e-4ed1-9aae-d1789cb10607 from instance 24485f47-6c01-4ebd-8d73-480885b4aa7c. Nov 10 04:17:52.670926 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5cac8274-bbb7-41f9-962b-e3fa4df8ffd3 tempest-VolumesActionsTest-1833696072 None] Detach volume completed successfully. Nov 10 04:17:52.677733 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5cac8274-bbb7-41f9-962b-e3fa4df8ffd3 tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607-detach_volume'" released by "detach_volume" :: held 0.136s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:17:58.407114 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-0802edaa-36ca-4aa1-b8eb-14dd2eb1da79 tempest-VolumesActionsTest-1833696072 None] Running cmd (subprocess): rbd export --pool volumes volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607 /opt/stack/data/cinder/conversion/volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607-38880514-ea34-45b6-882d-e36ce779fd22 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:17:58.839959 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:17:58.859322 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:17:58.859957 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:17:58.896149 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Flow 'volume_create_manager' (874e40f3-29e1-4336-b44c-ae10a7ed6a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:58.900643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f254ebb-e4c7-4a5a-ab87-db29836b4995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:58.918607 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:17:58.945476 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f254ebb-e4c7-4a5a-ab87-db29836b4995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-399126081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=f118fd10-6fce-487b-967a-77341dfb4d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16946d4a8d945b6b316d212abca4f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:17:59Z,use_quota=True,user_id='704f4755d3f446429725f2b66cd8a672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:58.948053 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92009689-5daf-4470-83bd-fb781a538f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:58.950459 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92009689-5daf-4470-83bd-fb781a538f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:58.957785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97483b7-1af8-4f69-b8dc-ee8fe0c5911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:58.960147 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97483b7-1af8-4f69-b8dc-ee8fe0c5911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f118fd10-6fce-487b-967a-77341dfb4d50', 'volume_name': 'volume-f118fd10-6fce-487b-967a-77341dfb4d50', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:58.963880 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf7f823-7fa3-473b-899e-40b66b498f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:58.966089 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf7f823-7fa3-473b-899e-40b66b498f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:58.968294 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aa14fe-1f26-4665-9df1-43f3cf8ff4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:58.969137 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume f118fd10-6fce-487b-967a-77341dfb4d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f118fd10-6fce-487b-967a-77341dfb4d50', 'volume_size': 1} Nov 10 04:17:58.969743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] creating volume 'volume-f118fd10-6fce-487b-967a-77341dfb4d50' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:17:58.971065 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:17:59.096903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:17:59.097531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:17:59.099831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77aa14fe-1f26-4665-9df1-43f3cf8ff4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f118fd10-6fce-487b-967a-77341dfb4d50', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:59.108307 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fc5cec-51b9-4dd0-a70e-ace4d2e5e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:17:59.131601 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume volume-f118fd10-6fce-487b-967a-77341dfb4d50 (f118fd10-6fce-487b-967a-77341dfb4d50): created successfully Nov 10 04:17:59.137741 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fc5cec-51b9-4dd0-a70e-ace4d2e5e38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:17:59.145868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Flow 'volume_create_manager' (874e40f3-29e1-4336-b44c-ae10a7ed6a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:17:59.165827 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0feaacb9-53eb-4803-bb27-bb0a6ff4fbed tempest-AttachVolumeShelveTestJSON-1859284425 None] Created volume successfully. Nov 10 04:17:59.403711 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-0802edaa-36ca-4aa1-b8eb-14dd2eb1da79 tempest-VolumesActionsTest-1833696072 None] CMD "rbd export --pool volumes volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607 /opt/stack/data/cinder/conversion/volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607-38880514-ea34-45b6-882d-e36ce779fd22 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:17:59.412581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.image_utils [None req-0802edaa-36ca-4aa1-b8eb-14dd2eb1da79 tempest-VolumesActionsTest-1833696072 None] 38880514-ea34-45b6-882d-e36ce779fd22 was raw, no need to convert to raw {{(pid=127842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Nov 10 04:18:19.942742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-0802edaa-36ca-4aa1-b8eb-14dd2eb1da79 tempest-VolumesActionsTest-1833696072 None] Uploaded volume to glance image-id: 38880514-ea34-45b6-882d-e36ce779fd22. {{(pid=127842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Nov 10 04:18:19.966989 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0802edaa-36ca-4aa1-b8eb-14dd2eb1da79 tempest-VolumesActionsTest-1833696072 None] Copy volume to image completed successfully. Nov 10 04:18:27.981717 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:18:28.069278 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:28.167063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:18:28.167654 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] Volume volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:18:28.184248 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] deleting rbd volume volume-f62c0c9c-425e-4ed1-9aae-d1789cb10607 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:18:28.554555 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:18:28.555708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:28.600674 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:28.691555 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:18:28.751686 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] Created reservations ['cbdbdc9b-4c62-4501-a46f-1d9dea88623a', '82fafddf-3646-4555-b367-48cbfe1d4ae2', 'aaccd3ad-b505-4e24-934b-e55d729aa6a0', 'c9fa0fc4-69a1-41f7-a398-56234a4d827b'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:18:28.828925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:28.895535 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:28.948073 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:18:28.952849 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] Deleted volume successfully. Nov 10 04:18:28.979065 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-b1983220-84d6-49ff-b224-8218ade6bdce tempest-VolumesActionsTest-1833696072 None] Lock "b'cinder-f62c0c9c-425e-4ed1-9aae-d1789cb10607-delete_volume'" released by "delete_volume" :: held 0.997s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:18:32.124515 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:18:32.128159 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:18:32.128658 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:18:32.140975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Flow 'volume_create_manager' (f7d8322b-38b2-4d60-9b2b-d8b43f61ec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:32.144595 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea6141c-34c8-4e3e-a902-7d68f749dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:32.150763 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:18:32.163926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea6141c-34c8-4e3e-a902-7d68f749dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1709862900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=06f38f32-86cf-4579-af7e-a9ce2ac39532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013b9c6863cb415e8f96c6f0a835d4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:18:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:18:32Z,use_quota=True,user_id='690c6ac9dc834ddc963a086baee55fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:32.166504 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f9f48f-02ee-4a24-9b4a-c8aed23d81b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:32.168635 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f9f48f-02ee-4a24-9b4a-c8aed23d81b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:32.171006 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c7703d-d44c-40c7-9755-5b70345d93e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:32.173239 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c7703d-d44c-40c7-9755-5b70345d93e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f38f32-86cf-4579-af7e-a9ce2ac39532', 'volume_name': 'volume-06f38f32-86cf-4579-af7e-a9ce2ac39532', 'volume_size': 2}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:32.175488 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18a2f5c-2bb5-4018-bf51-9f003af41db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:32.177615 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18a2f5c-2bb5-4018-bf51-9f003af41db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:32.180579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06433c5a-9982-4526-ae8b-1ebf2a702fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:32.181338 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Volume 06f38f32-86cf-4579-af7e-a9ce2ac39532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f38f32-86cf-4579-af7e-a9ce2ac39532', 'volume_size': 2} Nov 10 04:18:32.181735 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] creating volume 'volume-06f38f32-86cf-4579-af7e-a9ce2ac39532' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:18:32.182723 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:32.246887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:18:32.247254 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:18:32.249281 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06433c5a-9982-4526-ae8b-1ebf2a702fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f38f32-86cf-4579-af7e-a9ce2ac39532', 'volume_size': 2}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:32.251382 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bd8d06-3fae-4b67-a1c5-da17c3cd542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:32.261223 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Volume volume-06f38f32-86cf-4579-af7e-a9ce2ac39532 (06f38f32-86cf-4579-af7e-a9ce2ac39532): created successfully Nov 10 04:18:32.263160 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bd8d06-3fae-4b67-a1c5-da17c3cd542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:32.266207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Flow 'volume_create_manager' (f7d8322b-38b2-4d60-9b2b-d8b43f61ec10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:32.275003 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-83ff145a-5bab-468d-840b-f015b34589f1 tempest-VolumesCloneNegativeTest-1523202028 None] Created volume successfully. Nov 10 04:18:32.560083 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-2ab73723-b1f5-4c89-9b71-7ad328f6ae61 req-08b248ef-37f5-4f64-a611-b2ab60cfcc70 tempest-AttachVolumeTestJSON-389116424 None] Terminate volume connection completed successfully. Nov 10 04:18:32.560595 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-2ab73723-b1f5-4c89-9b71-7ad328f6ae61 req-08b248ef-37f5-4f64-a611-b2ab60cfcc70 tempest-AttachVolumeTestJSON-389116424 None] Deleting attachment 94143a5d-bce8-4bb2-b428-77b12ea20758. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:18:33.269868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cf7419dc-89c6-4d52-a916-7c18f1f2741f req-42a397ad-6b17-4a88-b35f-6630623aed89 tempest-AttachVolumeShelveTestJSON-1859284425 None] No connector for attachment 62bd2044-85c1-44c1-a7a9-c9ef9f0ba217; skipping storage backend terminate_connection call. {{(pid=127842) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4899}} Nov 10 04:18:33.270456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cf7419dc-89c6-4d52-a916-7c18f1f2741f req-42a397ad-6b17-4a88-b35f-6630623aed89 tempest-AttachVolumeShelveTestJSON-1859284425 None] Deleting attachment 62bd2044-85c1-44c1-a7a9-c9ef9f0ba217. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:18:33.346903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] Lock "b'cinder-06f38f32-86cf-4579-af7e-a9ce2ac39532-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:18:33.396041 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:33.436110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:18:33.436539 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] Volume volume-06f38f32-86cf-4579-af7e-a9ce2ac39532 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:18:33.445643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] deleting rbd volume volume-06f38f32-86cf-4579-af7e-a9ce2ac39532 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:18:33.743604 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] Created reservations ['bb6bb0bb-9baa-4d2f-bba2-c7847038196f', 'abbea958-03b6-42ac-b894-0d2fb3126e6b', 'f226d972-930f-4fe3-b50f-eb2704803428', '3577db1f-af3a-46e4-b3ba-97198ba168b3'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:18:33.811034 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:33.856421 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:33.901178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:18:33.905631 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] Deleted volume successfully. Nov 10 04:18:33.921535 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-4cde58a3-5273-4462-ba3a-a20a272943d2 tempest-VolumesCloneNegativeTest-1523202028 None] Lock "b'cinder-06f38f32-86cf-4579-af7e-a9ce2ac39532-delete_volume'" released by "delete_volume" :: held 0.575s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:18:36.997508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:18:37.010556 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:18:37.011187 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:18:37.029717 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Flow 'volume_create_manager' (c34732a4-7949-431e-b737-4b12add406da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:37.033784 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f8ed86-068c-430d-91e0-d9c819064acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:37.040934 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:18:37.053919 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f8ed86-068c-430d-91e0-d9c819064acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-903758647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39843a8d6afa4f72b1f720499a5737db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:18:37Z,use_quota=True,user_id='9484b3ee637848caa0c67b233a185044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:37.056440 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce653fcd-e5a7-43cd-aa23-d2dc4c9a7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:37.058627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce653fcd-e5a7-43cd-aa23-d2dc4c9a7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:37.061327 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d4f1ea-5d44-45a9-b152-89b1d436d55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:37.063803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d4f1ea-5d44-45a9-b152-89b1d436d55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1', 'volume_name': 'volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:37.066214 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff2a63b-ef54-464e-b06b-3192e258a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:37.069837 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff2a63b-ef54-464e-b06b-3192e258a506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:37.071966 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aac5c2-591e-4188-8643-81eb60fa1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:37.072961 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Volume 1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1', 'volume_size': 1} Nov 10 04:18:37.073348 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] creating volume 'volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:18:37.074335 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:37.148636 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:18:37.149036 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:18:37.151182 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aac5c2-591e-4188-8643-81eb60fa1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:37.154764 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af6a1be-7009-412f-8fae-04ba3e9ee761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:37.165251 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Volume volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1 (1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1): created successfully Nov 10 04:18:37.167160 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af6a1be-7009-412f-8fae-04ba3e9ee761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:37.170240 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Flow 'volume_create_manager' (c34732a4-7949-431e-b737-4b12add406da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:37.178171 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-02c7c77f-38db-4f84-b5c0-5b7c77fab50f tempest-VolumesListTestJSON-1531626224 None] Created volume successfully. Nov 10 04:18:38.851333 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:18:38.855389 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:18:38.856445 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:18:38.873325 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Flow 'volume_create_manager' (ca23051a-c059-4f37-9407-745f15dfcede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:38.879023 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abfbe13-007a-46ee-8a3b-b3fb59592792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:38.888093 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:18:38.909714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abfbe13-007a-46ee-8a3b-b3fb59592792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-954761664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=aa59bde3-10a6-44e8-acab-601092e6efa2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39843a8d6afa4f72b1f720499a5737db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:18:39Z,use_quota=True,user_id='9484b3ee637848caa0c67b233a185044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:38.914100 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b053cbe3-7b61-45d5-920c-54e0280b72fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:38.917646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b053cbe3-7b61-45d5-920c-54e0280b72fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:38.922596 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffa0d8e-3dd7-4e11-928a-0fc7011dff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:38.925796 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffa0d8e-3dd7-4e11-928a-0fc7011dff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa59bde3-10a6-44e8-acab-601092e6efa2', 'volume_name': 'volume-aa59bde3-10a6-44e8-acab-601092e6efa2', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:38.929657 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bbc912-9ac5-4f00-a275-faa6c34df190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:38.932393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bbc912-9ac5-4f00-a275-faa6c34df190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:38.938902 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a259ba09-37b3-44b5-bf62-3c06efac5b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:38.939913 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Volume aa59bde3-10a6-44e8-acab-601092e6efa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa59bde3-10a6-44e8-acab-601092e6efa2', 'volume_size': 1} Nov 10 04:18:38.940572 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] creating volume 'volume-aa59bde3-10a6-44e8-acab-601092e6efa2' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:18:38.942166 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:39.086647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:18:39.088130 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:18:39.092007 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a259ba09-37b3-44b5-bf62-3c06efac5b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa59bde3-10a6-44e8-acab-601092e6efa2', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:39.095821 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0013644f-b5ce-4d0d-8598-243977336319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:39.110992 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Volume volume-aa59bde3-10a6-44e8-acab-601092e6efa2 (aa59bde3-10a6-44e8-acab-601092e6efa2): created successfully Nov 10 04:18:39.113739 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0013644f-b5ce-4d0d-8598-243977336319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:39.126732 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Flow 'volume_create_manager' (ca23051a-c059-4f37-9407-745f15dfcede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:39.145275 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-94b17e21-b851-44a8-959a-e6f597bdcdb0 tempest-VolumesListTestJSON-1531626224 None] Created volume successfully. Nov 10 04:18:40.388085 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:18:40.391670 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:18:40.392320 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:18:40.431520 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Flow 'volume_create_manager' (a2cb258e-fe1d-42db-b197-33feb6d1b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:40.439838 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dbeb56-bdab-47a7-ba5e-ebd53d9acad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:40.449404 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:18:40.476211 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dbeb56-bdab-47a7-ba5e-ebd53d9acad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-639512295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=09412b5d-ffad-44da-9953-899e1491a923,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39843a8d6afa4f72b1f720499a5737db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:18:40Z,use_quota=True,user_id='9484b3ee637848caa0c67b233a185044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:40.480578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3358da6e-2195-4cb4-abc8-d25589eda6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:40.482817 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3358da6e-2195-4cb4-abc8-d25589eda6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:40.489836 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65071bbf-cbf7-4eab-8ed9-3c5d33cf5fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:40.494598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65071bbf-cbf7-4eab-8ed9-3c5d33cf5fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09412b5d-ffad-44da-9953-899e1491a923', 'volume_name': 'volume-09412b5d-ffad-44da-9953-899e1491a923', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:40.498129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44add55f-5ec5-40a5-b0d8-12fb364908c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:40.500719 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44add55f-5ec5-40a5-b0d8-12fb364908c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:40.503410 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932b97e2-3ad5-45cb-a8dc-4ced878806a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:40.504466 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Volume 09412b5d-ffad-44da-9953-899e1491a923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09412b5d-ffad-44da-9953-899e1491a923', 'volume_size': 1} Nov 10 04:18:40.505084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] creating volume 'volume-09412b5d-ffad-44da-9953-899e1491a923' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:18:40.506651 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:40.632830 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:18:40.633694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:18:40.637477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932b97e2-3ad5-45cb-a8dc-4ced878806a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09412b5d-ffad-44da-9953-899e1491a923', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:40.639949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311992b0-12cd-48b5-870c-8c2616f7b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:40.650401 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Volume volume-09412b5d-ffad-44da-9953-899e1491a923 (09412b5d-ffad-44da-9953-899e1491a923): created successfully Nov 10 04:18:40.652367 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311992b0-12cd-48b5-870c-8c2616f7b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:40.655578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Flow 'volume_create_manager' (a2cb258e-fe1d-42db-b197-33feb6d1b180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:40.665116 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d8ed1f43-cf28-4082-a6e0-f2b56abfe567 tempest-VolumesListTestJSON-1531626224 None] Created volume successfully. Nov 10 04:18:45.344633 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] Lock "b'cinder-09412b5d-ffad-44da-9953-899e1491a923-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:18:45.395956 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:45.496563 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:18:45.497362 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] Volume volume-09412b5d-ffad-44da-9953-899e1491a923 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:18:45.518601 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] deleting rbd volume volume-09412b5d-ffad-44da-9953-899e1491a923 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:18:45.964507 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] Created reservations ['6b6edf73-9d35-42c1-8f77-c8113ec38897', '01b5f696-9fce-4723-a88d-05d521375acf', '3befeefc-6006-4ef8-962f-40a9222ec8bd', '8840fed6-bf8b-4538-bc6c-99180d98ac40'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:18:46.087995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:46.176441 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:46.240654 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:18:46.246977 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] Deleted volume successfully. Nov 10 04:18:46.276643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-4c71d3f2-a6d0-4886-870a-c0199265a700 tempest-VolumesListTestJSON-1531626224 None] Lock "b'cinder-09412b5d-ffad-44da-9953-899e1491a923-delete_volume'" released by "delete_volume" :: held 0.932s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:18:46.607210 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] Lock "b'cinder-aa59bde3-10a6-44e8-acab-601092e6efa2-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:18:46.715349 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:46.768968 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:18:46.769819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] Volume volume-aa59bde3-10a6-44e8-acab-601092e6efa2 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:18:46.786558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] deleting rbd volume volume-aa59bde3-10a6-44e8-acab-601092e6efa2 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:18:47.215311 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] Created reservations ['347b30de-f6af-487b-93dd-23ca86829f4e', 'c378abbf-070d-4e81-8a8f-6c0081ccbb2f', '5ec7adf6-2357-49ea-8eb9-9d97a36e4a18', '82dfa632-a445-4680-80de-3fcca6bca175'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:18:47.314664 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:47.416003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:47.480533 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:18:47.486633 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] Deleted volume successfully. Nov 10 04:18:47.512337 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-10fcb74f-79fc-47b2-beeb-b2ab7a21e0f9 tempest-VolumesListTestJSON-1531626224 None] Lock "b'cinder-aa59bde3-10a6-44e8-acab-601092e6efa2-delete_volume'" released by "delete_volume" :: held 0.906s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:18:47.954991 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] Lock "b'cinder-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:18:48.048217 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:48.179287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:18:48.180162 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] Volume volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:18:48.190004 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] deleting rbd volume volume-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:18:48.611450 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] Created reservations ['648deffa-b1ce-43ed-b835-810a999e524f', '43add947-6472-4e71-bea0-b72a0540140f', '4e60fd2d-f120-434e-8a53-81b5777d1674', 'e9296fda-453f-4e00-8080-4254443411cd'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:18:48.700485 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:48.775986 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:48.869048 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:18:48.873413 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] Deleted volume successfully. Nov 10 04:18:48.896829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3d50034a-9242-4aee-96d0-65e0d0325e1f tempest-VolumesListTestJSON-1531626224 None] Lock "b'cinder-1f17502f-ca43-46e7-bb4f-dc4bfeeeafa1-delete_volume'" released by "delete_volume" :: held 0.943s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:18:53.140261 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:18:53.145773 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:18:53.162966 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:18:53.218672 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Flow 'volume_create_manager' (efc4a62e-cb80-4e5d-808b-3837a031f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:53.225842 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f1ef17-1bb7-4bd4-b99e-fd3ad4f01384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:53.240944 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:18:53.291806 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f1ef17-1bb7-4bd4-b99e-fd3ad4f01384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1812184240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=422b7162-302e-467d-bc00-d73e61a9827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7871a17d74c24db48d01976d917fdf16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:18:53Z,use_quota=True,user_id='1509f508db444f48a31f2ee0c980842f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:53.300085 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12146c8e-187e-4251-b7bc-0f330ac3f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:53.303460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12146c8e-187e-4251-b7bc-0f330ac3f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:53.307054 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cf1471-18f9-4424-8e7b-f05f1ecd70ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:53.310876 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cf1471-18f9-4424-8e7b-f05f1ecd70ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422b7162-302e-467d-bc00-d73e61a9827a', 'volume_name': 'volume-422b7162-302e-467d-bc00-d73e61a9827a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:53.314370 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001c9657-4875-43e0-a025-8c777b6dd9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:53.317579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001c9657-4875-43e0-a025-8c777b6dd9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:53.323126 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d127f0d0-4a56-4296-9a96-4732f3da5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:53.324591 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Volume 422b7162-302e-467d-bc00-d73e61a9827a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422b7162-302e-467d-bc00-d73e61a9827a', 'volume_size': 1} Nov 10 04:18:53.325865 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] creating volume 'volume-422b7162-302e-467d-bc00-d73e61a9827a' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:18:53.327207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:18:53.508538 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:18:53.509134 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:18:53.511487 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d127f0d0-4a56-4296-9a96-4732f3da5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422b7162-302e-467d-bc00-d73e61a9827a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:53.514088 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09ecec-0d1d-4a03-8de3-6738d2f33482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:18:53.537710 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Volume volume-422b7162-302e-467d-bc00-d73e61a9827a (422b7162-302e-467d-bc00-d73e61a9827a): created successfully Nov 10 04:18:53.540145 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09ecec-0d1d-4a03-8de3-6738d2f33482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:18:53.549448 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Flow 'volume_create_manager' (efc4a62e-cb80-4e5d-808b-3837a031f95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:18:53.581528 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ae7ad742-aa35-4b7d-9a5d-6f6a558a34db tempest-VolumesNegativeTest-1187875732 None] Created volume successfully. Nov 10 04:19:16.242925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] Lock "b'cinder-62edb6ae-a3c5-4664-a62a-5a6e328168d5-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:19:16.299274 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:16.371982 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:19:16.372421 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] Volume volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:19:16.379062 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] deleting rbd volume volume-62edb6ae-a3c5-4664-a62a-5a6e328168d5 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:19:16.798338 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] Created reservations ['f10df7a4-95d5-4f88-aa8c-3a11df95467f', '40203ab3-1002-4a04-9210-a85ecdfb168a', '28ae361a-2b5e-4efa-8791-cd6bfecee8e8', 'dbf3ac4c-2803-4c2d-a78f-c51691635aa2'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:19:16.898231 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:16.972670 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:17.040041 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:19:17.046601 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] Deleted volume successfully. Nov 10 04:19:17.062125 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a17c9f84-51cb-47ad-9192-1e2c1b3db0c1 tempest-ServersNegativeTestJSON-928906600 None] Lock "b'cinder-62edb6ae-a3c5-4664-a62a-5a6e328168d5-delete_volume'" released by "delete_volume" :: held 0.820s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:19:17.378756 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] Lock "b'cinder-24e94d61-d44f-42f6-9758-672401cefbb8-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:19:17.418636 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:17.476370 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:19:17.477128 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] Volume volume-24e94d61-d44f-42f6-9758-672401cefbb8 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:19:17.485291 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] deleting rbd volume volume-24e94d61-d44f-42f6-9758-672401cefbb8 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:19:17.797867 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] Created reservations ['88599831-a120-4e8f-b859-ebdd843ec99f', 'f42d5eb9-1d6f-454a-adad-687f2cae41a6', 'e2041986-b1bc-4f37-a0db-b00a43f1e8dd', 'eef680db-dc7e-49d3-9ad8-d3731c4a2d64'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:19:17.862954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:17.902727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:17.941705 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:19:17.946350 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] Deleted volume successfully. Nov 10 04:19:17.962194 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-071f8388-460b-41ff-860d-1fbe8df863c6 tempest-ServersNegativeTestJSON-928906600 None] Lock "b'cinder-24e94d61-d44f-42f6-9758-672401cefbb8-delete_volume'" released by "delete_volume" :: held 0.584s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:19:18.434986 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] Lock "b'cinder-422b7162-302e-467d-bc00-d73e61a9827a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:19:18.476632 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:18.531523 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:19:18.531949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] Volume volume-422b7162-302e-467d-bc00-d73e61a9827a is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:19:18.538236 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] deleting rbd volume volume-422b7162-302e-467d-bc00-d73e61a9827a {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:19:18.810840 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] Created reservations ['f612d5b4-10f4-495c-8e90-42e7bbdf1757', '1b0bfd4a-dfcf-4264-825d-9119020c58fb', '6d388c96-ae0b-49b2-9fd5-235b79a43b2c', '16f60344-1c41-4d95-ba11-9e7e39a6b1c8'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:19:18.872375 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:18.903975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:18.931019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:19:18.934950 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] Deleted volume successfully. Nov 10 04:19:18.948067 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-52669137-1e32-4cbd-99a1-6c1a2b311c48 tempest-VolumesNegativeTest-1187875732 None] Lock "b'cinder-422b7162-302e-467d-bc00-d73e61a9827a-delete_volume'" released by "delete_volume" :: held 0.513s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:19:28.552303 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:19:28.554204 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:28.643027 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:28.715166 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:19:42.062449 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] Lock "b'cinder-f118fd10-6fce-487b-967a-77341dfb4d50-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:19:42.109509 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:42.188529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:19:42.189575 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume volume-f118fd10-6fce-487b-967a-77341dfb4d50 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:19:42.204688 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] deleting rbd volume volume-f118fd10-6fce-487b-967a-77341dfb4d50 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:19:42.595721 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] Created reservations ['64086691-27d3-43a9-84fb-6d29695cc4f5', '3f3223d3-5a7e-49d9-8696-cb34b369dea1', '85832c14-4d5b-49e5-aca1-3525869bd3d9', 'c72f2d9d-9e51-4c1a-a492-664badbea4b2'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:19:42.686718 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:42.776965 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:42.885545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:19:42.891476 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] Deleted volume successfully. Nov 10 04:19:42.930131 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-33371ce7-d0d0-474a-9a50-25452e56b81c tempest-AttachVolumeShelveTestJSON-1859284425 None] Lock "b'cinder-f118fd10-6fce-487b-967a-77341dfb4d50-delete_volume'" released by "delete_volume" :: held 0.867s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:19:43.515362 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] Lock "b'cinder-45d2c8b9-0863-46bd-a0f0-57df968a6a87-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:19:43.604468 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:43.727099 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:19:43.727863 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] Volume volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:19:43.737387 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] deleting rbd volume volume-45d2c8b9-0863-46bd-a0f0-57df968a6a87 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:19:44.238063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] Created reservations ['ad27ae09-c6a1-489f-bb44-738c06642eef', 'aa01c07f-6c1a-4f19-a2e2-67b89306dd12', '459e510e-7730-45ea-9e35-7811481d443a', 'bc067a38-243e-45ed-affa-48a8d25c2347'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:19:44.333953 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:44.397425 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:44.448991 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:19:44.454469 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] Deleted volume successfully. Nov 10 04:19:44.476333 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e53ee4fb-8d14-4d1f-8289-b137fea7335d tempest-AttachVolumeShelveTestJSON-1859284425 None] Lock "b'cinder-45d2c8b9-0863-46bd-a0f0-57df968a6a87-delete_volume'" released by "delete_volume" :: held 0.961s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:19:57.245344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:19:57.255739 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:19:57.257314 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:19:57.281659 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Flow 'volume_create_manager' (cbcb5e5b-830b-4bbe-aa2e-47fa36bbfa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:19:57.286484 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe2e1a5-8742-4c7f-bab6-3ee6dcde35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:19:57.294437 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:19:57.312002 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe2e1a5-8742-4c7f-bab6-3ee6dcde35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1199957801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=42d63a60-be1b-40a5-b58e-65bd01edd547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc6c1178ce447b7ac33663ea9dea21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:19:57Z,use_quota=True,user_id='89d53dad7e2b4d0cbeb6703d41da920b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:19:57.315447 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6436088-ecf2-4c59-a2d3-12189a931e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:19:57.318502 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6436088-ecf2-4c59-a2d3-12189a931e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:19:57.323598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fab29a-889f-4eac-a251-a24069d4e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:19:57.430887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fab29a-889f-4eac-a251-a24069d4e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42d63a60-be1b-40a5-b58e-65bd01edd547', 'volume_name': 'volume-42d63a60-be1b-40a5-b58e-65bd01edd547', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:19:57.434614 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf1f3af-e9f6-4d93-aa1a-7ea70afbc76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:19:57.437827 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf1f3af-e9f6-4d93-aa1a-7ea70afbc76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:19:57.440123 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f82e88-d41a-4941-a511-149ddbfe106f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:19:57.441781 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Volume 42d63a60-be1b-40a5-b58e-65bd01edd547: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42d63a60-be1b-40a5-b58e-65bd01edd547', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:19:57.442467 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Cloning 42d63a60-be1b-40a5-b58e-65bd01edd547 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:19:57.454519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:19:57.466623 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 19, 57, 459746)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:19:57.467588 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:19:57.468319 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:19:57.475856 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:19:57.477039 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:19:57.484925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 19, 57, 481516)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:19:57.486340 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:19:57.487766 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:19:57.512136 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:19:57.606941 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] creating snapshot='volume-42d63a60-be1b-40a5-b58e-65bd01edd547.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:19:57.887252 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-42d63a60-be1b-40a5-b58e-65bd01edd547.clone_snap' to 'volume-42d63a60-be1b-40a5-b58e-65bd01edd547' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:19:58.102048 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:19:58.103523 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:19:58.104368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:19:58.131059 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:19:58.131770 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Marking volume 42d63a60-be1b-40a5-b58e-65bd01edd547 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:19:58.141307 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 42d63a60-be1b-40a5-b58e-65bd01edd547. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:19:58.141979 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Creating volume glance metadata for volume 42d63a60-be1b-40a5-b58e-65bd01edd547 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:19:58.251652 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f82e88-d41a-4941-a511-149ddbfe106f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d63a60-be1b-40a5-b58e-65bd01edd547', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:19:58.254765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64e4e30-ed28-4348-8761-8e976e2f66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:19:58.289966 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Volume volume-42d63a60-be1b-40a5-b58e-65bd01edd547 (42d63a60-be1b-40a5-b58e-65bd01edd547): created successfully Nov 10 04:19:58.291914 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64e4e30-ed28-4348-8761-8e976e2f66a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:19:58.294869 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Flow 'volume_create_manager' (cbcb5e5b-830b-4bbe-aa2e-47fa36bbfa8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:19:58.314323 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a97927d4-52cb-4ad0-bab2-b36e96a54ad0 tempest-TestVolumeBackupRestore-697980072 None] Created volume successfully. Nov 10 04:20:00.192693 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-3c5e97ee-17cf-495c-a510-aacf23389205 tempest-TestVolumeBackupRestore-697980072 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:20:01.817183 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-3c5e97ee-17cf-495c-a510-aacf23389205 tempest-TestVolumeBackupRestore-697980072 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.624s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:20:01.818548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3c5e97ee-17cf-495c-a510-aacf23389205 tempest-TestVolumeBackupRestore-697980072 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-42d63a60-be1b-40a5-b58e-65bd01edd547', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '42d63a60-be1b-40a5-b58e-65bd01edd547', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:20:01.881413 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3c5e97ee-17cf-495c-a510-aacf23389205 tempest-TestVolumeBackupRestore-697980072 None] Initialize volume connection completed successfully. Nov 10 04:20:12.031340 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3c5e97ee-17cf-495c-a510-aacf23389205 tempest-TestVolumeBackupRestore-697980072 None] Terminate volume connection completed successfully. Nov 10 04:20:12.076011 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3c5e97ee-17cf-495c-a510-aacf23389205 tempest-TestVolumeBackupRestore-697980072 None] Remove volume export completed successfully. Nov 10 04:20:12.723169 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:20:12.727460 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:20:12.727969 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:20:12.741900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Flow 'volume_create_manager' (17d3b88e-1942-46d4-a321-1e9ef9de280a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:12.745585 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afc3fc-614f-4b44-ba39-7cf92f52b81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:12.752254 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:20:12.770934 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afc3fc-614f-4b44-ba39-7cf92f52b81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:20:12Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_fa7fe21a-9848-4933-a96b-b4e065c66873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b93f994a-1292-4d70-ba76-4630c86e4605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc6c1178ce447b7ac33663ea9dea21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:20:13Z,use_quota=True,user_id='89d53dad7e2b4d0cbeb6703d41da920b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:12.774720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c80314-aac1-4c20-95a6-d8d62ba7d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:12.778817 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c80314-aac1-4c20-95a6-d8d62ba7d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:12.783398 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9ddb47-adfb-4b27-92b0-dfc2161f1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:12.787083 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9ddb47-adfb-4b27-92b0-dfc2161f1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93f994a-1292-4d70-ba76-4630c86e4605', 'volume_name': 'volume-b93f994a-1292-4d70-ba76-4630c86e4605', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:12.793393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae2b4d8-3489-4eab-ab1f-d7ef7027298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:12.796807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae2b4d8-3489-4eab-ab1f-d7ef7027298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:12.799169 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a41dbd-c272-4296-9388-3057125c241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:12.810047 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Volume b93f994a-1292-4d70-ba76-4630c86e4605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93f994a-1292-4d70-ba76-4630c86e4605', 'volume_size': 1} Nov 10 04:20:12.810484 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] creating volume 'volume-b93f994a-1292-4d70-ba76-4630c86e4605' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:20:12.811677 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:12.947937 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:20:12.948641 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:20:12.950760 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a41dbd-c272-4296-9388-3057125c241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93f994a-1292-4d70-ba76-4630c86e4605', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:12.953207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29591c22-d361-4538-a623-d9b26f3ae9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:12.965076 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Volume volume-b93f994a-1292-4d70-ba76-4630c86e4605 (b93f994a-1292-4d70-ba76-4630c86e4605): created successfully Nov 10 04:20:12.967507 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29591c22-d361-4538-a623-d9b26f3ae9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:12.970423 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Flow 'volume_create_manager' (17d3b88e-1942-46d4-a321-1e9ef9de280a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:12.979951 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Created volume successfully. Nov 10 04:20:13.936670 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:20:14.914434 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.980s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:20:14.915644 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b93f994a-1292-4d70-ba76-4630c86e4605', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'b93f994a-1292-4d70-ba76-4630c86e4605', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:20:14.932281 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Initialize volume connection completed successfully. Nov 10 04:20:22.404297 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Terminate volume connection completed successfully. Nov 10 04:20:22.427944 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-51b31998-6cdc-4beb-82d4-86fd54aa5bc1 tempest-TestVolumeBackupRestore-697980072 None] Remove volume export completed successfully. Nov 10 04:20:28.552808 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:20:28.554753 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:28.618282 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:28.679136 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:20:32.307261 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-f5b482d2-241f-4670-a55d-ab12ffcf74b2 req-2cfe12b5-0103-4a7b-95fa-592493b00d4d tempest-TestVolumeBackupRestore-697980072 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:20:33.303707 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-f5b482d2-241f-4670-a55d-ab12ffcf74b2 req-2cfe12b5-0103-4a7b-95fa-592493b00d4d tempest-TestVolumeBackupRestore-697980072 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:20:33.304682 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-f5b482d2-241f-4670-a55d-ab12ffcf74b2 req-2cfe12b5-0103-4a7b-95fa-592493b00d4d tempest-TestVolumeBackupRestore-697980072 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b93f994a-1292-4d70-ba76-4630c86e4605', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'b93f994a-1292-4d70-ba76-4630c86e4605', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:20:33.347669 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-f5b482d2-241f-4670-a55d-ab12ffcf74b2 req-2cfe12b5-0103-4a7b-95fa-592493b00d4d tempest-TestVolumeBackupRestore-697980072 None] Connection info returned from driver {'name': 'volumes/volume-b93f994a-1292-4d70-ba76-4630c86e4605', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b93f994a-1292-4d70-ba76-4630c86e4605', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '30f732c4-86d4-41c6-8fb4-570fc159af7c'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:20:33.462497 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-f5b482d2-241f-4670-a55d-ab12ffcf74b2 req-2cfe12b5-0103-4a7b-95fa-592493b00d4d tempest-TestVolumeBackupRestore-697980072 None] attachment_update completed successfully. Nov 10 04:20:37.992918 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:20:38.000901 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:20:38.001551 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:20:38.020402 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Flow 'volume_create_manager' (6d1d5fd4-f19d-4876-adc8-9de373957819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:38.023861 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df17efc5-84de-4962-939b-9bd76eb1e9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:38.031293 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:20:38.048846 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df17efc5-84de-4962-939b-9bd76eb1e9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1916678352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=67013a47-e339-4195-ac60-eddfad1113bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1075e0643e54959a5a5fdb8d890b466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:20:38Z,use_quota=True,user_id='25618a58d53048d0adb2e99ad35cade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:38.051935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28b6cd7-21d2-496e-b686-38c028d38a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:38.054239 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28b6cd7-21d2-496e-b686-38c028d38a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:38.057488 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6ea21f-e13a-4190-8fa5-fe3c35978f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:38.060297 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6ea21f-e13a-4190-8fa5-fe3c35978f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67013a47-e339-4195-ac60-eddfad1113bb', 'volume_name': 'volume-67013a47-e339-4195-ac60-eddfad1113bb', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:38.063653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b910a8-7c1f-44d8-971f-0227068dca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:38.066581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b910a8-7c1f-44d8-971f-0227068dca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:38.069032 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cc6b48-07c4-47ca-871f-0f316b1c80b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:38.069878 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Volume 67013a47-e339-4195-ac60-eddfad1113bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67013a47-e339-4195-ac60-eddfad1113bb', 'volume_size': 1} Nov 10 04:20:38.070295 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] creating volume 'volume-67013a47-e339-4195-ac60-eddfad1113bb' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:20:38.072429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:38.158951 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:20:38.159652 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:20:38.161992 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cc6b48-07c4-47ca-871f-0f316b1c80b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67013a47-e339-4195-ac60-eddfad1113bb', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:38.164527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b54ec4-9949-491a-bc85-2e76114f731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:38.175184 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Volume volume-67013a47-e339-4195-ac60-eddfad1113bb (67013a47-e339-4195-ac60-eddfad1113bb): created successfully Nov 10 04:20:38.177333 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b54ec4-9949-491a-bc85-2e76114f731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:38.180597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Flow 'volume_create_manager' (6d1d5fd4-f19d-4876-adc8-9de373957819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:38.191696 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a3e4e388-5b0a-42e0-adbd-7c047af95210 tempest-VolumesTestJSON-134090723 None] Created volume successfully. Nov 10 04:20:39.471596 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:20:39.475789 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:20:39.476805 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:20:39.495325 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Flow 'volume_create_manager' (65301a97-b3ae-45d8-ad9e-20863e67b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:39.498527 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3ad8ce-48fe-4e35-a19f-aa66bb96e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:39.506176 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:20:39.519749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3ad8ce-48fe-4e35-a19f-aa66bb96e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1469150304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=6149f377-60e5-4406-a6d3-9f4d01e032d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1075e0643e54959a5a5fdb8d890b466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:20:39Z,use_quota=True,user_id='25618a58d53048d0adb2e99ad35cade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:39.522493 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31305ae0-1dbc-4df4-85b3-b09764fbcd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:39.524563 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31305ae0-1dbc-4df4-85b3-b09764fbcd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:39.526877 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9580b5-5096-4087-a2ec-be944f29c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:39.529141 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9580b5-5096-4087-a2ec-be944f29c566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6149f377-60e5-4406-a6d3-9f4d01e032d1', 'volume_name': 'volume-6149f377-60e5-4406-a6d3-9f4d01e032d1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:39.531655 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470c65d9-d767-420a-8b72-7241bbfc387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:39.533737 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470c65d9-d767-420a-8b72-7241bbfc387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:39.535878 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef67e804-d7cd-40a0-a795-1139144e6ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:39.536850 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Volume 6149f377-60e5-4406-a6d3-9f4d01e032d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6149f377-60e5-4406-a6d3-9f4d01e032d1', 'volume_size': 1} Nov 10 04:20:39.537256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] creating volume 'volume-6149f377-60e5-4406-a6d3-9f4d01e032d1' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:20:39.538859 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:39.611129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:20:39.611729 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:20:39.614271 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef67e804-d7cd-40a0-a795-1139144e6ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6149f377-60e5-4406-a6d3-9f4d01e032d1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:39.617068 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ad6ad4-3232-4d9a-9f6f-9ec8fd23dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:39.628918 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Volume volume-6149f377-60e5-4406-a6d3-9f4d01e032d1 (6149f377-60e5-4406-a6d3-9f4d01e032d1): created successfully Nov 10 04:20:39.633699 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ad6ad4-3232-4d9a-9f6f-9ec8fd23dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:39.645785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Flow 'volume_create_manager' (65301a97-b3ae-45d8-ad9e-20863e67b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:39.659550 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f1e04ba8-3888-489c-b232-fa25e3a21612 tempest-VolumesTestJSON-134090723 None] Created volume successfully. Nov 10 04:20:40.976414 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:20:40.980209 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:20:40.981230 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:20:40.996414 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Flow 'volume_create_manager' (943cd1da-0580-4353-89ea-f033b4c33a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:41.002733 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6dd71cf-4254-4786-acab-0c0d9609011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:41.012186 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:20:41.027923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6dd71cf-4254-4786-acab-0c0d9609011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1118535873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=5e6529fe-a353-453b-842a-123914e3c671,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1075e0643e54959a5a5fdb8d890b466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:20:41Z,use_quota=True,user_id='25618a58d53048d0adb2e99ad35cade0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:41.031104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66ea2f6-f45e-4c62-a972-b3238148b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:41.033456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66ea2f6-f45e-4c62-a972-b3238148b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:41.035960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6054df09-7c0b-452c-ba0a-c23e144e5662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:41.038687 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6054df09-7c0b-452c-ba0a-c23e144e5662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6529fe-a353-453b-842a-123914e3c671', 'volume_name': 'volume-5e6529fe-a353-453b-842a-123914e3c671', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:41.041706 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba6bc6b-1b19-4340-a9ba-acdead54bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:41.043995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba6bc6b-1b19-4340-a9ba-acdead54bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:41.052757 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65dee285-2f75-4d45-aaae-38d9ca2eadb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:41.054970 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Volume 5e6529fe-a353-453b-842a-123914e3c671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6529fe-a353-453b-842a-123914e3c671', 'volume_size': 1} Nov 10 04:20:41.055566 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] creating volume 'volume-5e6529fe-a353-453b-842a-123914e3c671' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:20:41.057048 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:41.192233 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:20:41.192626 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:20:41.194643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65dee285-2f75-4d45-aaae-38d9ca2eadb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6529fe-a353-453b-842a-123914e3c671', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:41.197624 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ee87d6-f0cc-45e7-a10f-16a03a11a4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:20:41.216571 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Volume volume-5e6529fe-a353-453b-842a-123914e3c671 (5e6529fe-a353-453b-842a-123914e3c671): created successfully Nov 10 04:20:41.218631 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ee87d6-f0cc-45e7-a10f-16a03a11a4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:20:41.222165 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Flow 'volume_create_manager' (943cd1da-0580-4353-89ea-f033b4c33a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:20:41.244190 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-92888453-19ea-4dc0-922e-83a5a6e99dd4 tempest-VolumesTestJSON-134090723 None] Created volume successfully. Nov 10 04:20:43.435975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] Lock "b'cinder-5e6529fe-a353-453b-842a-123914e3c671-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:20:43.515345 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:43.610007 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:20:43.611342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] Volume volume-5e6529fe-a353-453b-842a-123914e3c671 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:20:43.636658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] deleting rbd volume volume-5e6529fe-a353-453b-842a-123914e3c671 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:20:44.071757 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] Created reservations ['04e1526f-5b83-45f2-938e-f72dec58713e', '8f099c60-008c-419a-9cef-1d81555de4ab', '5005da48-1453-4fc9-be08-dfec0e7f18a2', '8acc8d17-208d-4bd0-be15-a76e298ca69f'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:20:44.133065 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:44.195150 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:44.248844 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:20:44.266638 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] Deleted volume successfully. Nov 10 04:20:44.290043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2801337b-12b8-4bd4-9d08-81f09270a030 tempest-VolumesTestJSON-134090723 None] Lock "b'cinder-5e6529fe-a353-453b-842a-123914e3c671-delete_volume'" released by "delete_volume" :: held 0.854s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:20:44.625889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] Lock "b'cinder-6149f377-60e5-4406-a6d3-9f4d01e032d1-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:20:44.682459 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:44.746295 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:20:44.746724 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] Volume volume-6149f377-60e5-4406-a6d3-9f4d01e032d1 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:20:44.755343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] deleting rbd volume volume-6149f377-60e5-4406-a6d3-9f4d01e032d1 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:20:45.131055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] Created reservations ['39d4e341-5699-43fa-986c-0c1a8f30c769', '5ad4f74f-ec86-44bb-9116-ee9fde35f19d', '7b5f6984-9294-476e-858d-411ebd7f1cb0', '3fe3155e-aed1-46e6-a5d5-891ff18df0af'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:20:45.208094 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:45.280868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:45.327739 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:20:45.333226 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] Deleted volume successfully. Nov 10 04:20:45.352895 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0acf843f-43dd-48ba-be57-704cb3898332 tempest-VolumesTestJSON-134090723 None] Lock "b'cinder-6149f377-60e5-4406-a6d3-9f4d01e032d1-delete_volume'" released by "delete_volume" :: held 0.727s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:20:45.797541 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] Lock "b'cinder-67013a47-e339-4195-ac60-eddfad1113bb-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:20:45.868331 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:45.960554 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:20:45.965310 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] Volume volume-67013a47-e339-4195-ac60-eddfad1113bb is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:20:45.973594 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] deleting rbd volume volume-67013a47-e339-4195-ac60-eddfad1113bb {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:20:46.334629 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] Created reservations ['2fbd80a9-e55c-429d-b30d-153c20e7af1e', 'e0f7686f-88c2-4e33-bba0-274cc00b957e', 'd0e007c1-0ddc-4b5b-b05f-46a71efb32d9', '0e7bc4e4-dd7b-4ae7-a9fe-8a0320f8e6ca'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:20:46.387067 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:46.444101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:20:46.488279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:20:46.496411 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] Deleted volume successfully. Nov 10 04:20:46.511721 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-343d0cbc-64a3-4cc5-9bbc-5986ef1ff531 tempest-VolumesTestJSON-134090723 None] Lock "b'cinder-67013a47-e339-4195-ac60-eddfad1113bb-delete_volume'" released by "delete_volume" :: held 0.714s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:21:23.204956 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:21:23.210693 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:21:23.211192 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:21:23.226867 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Flow 'volume_create_manager' (21236918-ecef-41f6-a6d0-873d34484488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:23.231546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65ed1e-0725-4aa8-b48a-a380fcedef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:23.241768 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:21:23.258528 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e65ed1e-0725-4aa8-b48a-a380fcedef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1013228079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=e32d441c-cdd5-409d-8a58-42a930632d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a2ec0afddf403183d9d44778510b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:21:23Z,use_quota=True,user_id='694bd6d882cd4099b51d58a50f6f1ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:23.262599 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdac222-8103-406c-b249-3898b7ed28b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:23.265635 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdac222-8103-406c-b249-3898b7ed28b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:23.269521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637e5442-dcbe-4d80-aa0e-f404d0c0f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:23.273466 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637e5442-dcbe-4d80-aa0e-f404d0c0f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32d441c-cdd5-409d-8a58-42a930632d90', 'volume_name': 'volume-e32d441c-cdd5-409d-8a58-42a930632d90', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:23.277536 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22d452f-718c-4554-8e3b-f4238445ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:23.280280 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22d452f-718c-4554-8e3b-f4238445ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:23.283213 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4f8c26-95f0-441f-ad76-b96bb066fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:23.284190 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Volume e32d441c-cdd5-409d-8a58-42a930632d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32d441c-cdd5-409d-8a58-42a930632d90', 'volume_size': 1} Nov 10 04:21:23.285037 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] creating volume 'volume-e32d441c-cdd5-409d-8a58-42a930632d90' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:21:23.286991 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:23.432105 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:21:23.432587 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:21:23.435012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4f8c26-95f0-441f-ad76-b96bb066fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32d441c-cdd5-409d-8a58-42a930632d90', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:23.438147 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964d0873-82bd-466b-adcd-933934dc948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:23.450780 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Volume volume-e32d441c-cdd5-409d-8a58-42a930632d90 (e32d441c-cdd5-409d-8a58-42a930632d90): created successfully Nov 10 04:21:23.455952 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964d0873-82bd-466b-adcd-933934dc948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:23.460423 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Flow 'volume_create_manager' (21236918-ecef-41f6-a6d0-873d34484488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:23.473097 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d62ea4ac-947c-478b-babf-e7743f387c65 tempest-AttachVolumeTestJSON-389116424 None] Created volume successfully. Nov 10 04:21:24.942963 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-b29b9157-be84-4709-8afe-3444bc848d92 req-5db7d9da-5c51-4ac0-96d0-9cf9a1c1b6ff tempest-AttachVolumeTestJSON-389116424 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:21:25.982958 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-b29b9157-be84-4709-8afe-3444bc848d92 req-5db7d9da-5c51-4ac0-96d0-9cf9a1c1b6ff tempest-AttachVolumeTestJSON-389116424 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.039s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:21:25.983984 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-b29b9157-be84-4709-8afe-3444bc848d92 req-5db7d9da-5c51-4ac0-96d0-9cf9a1c1b6ff tempest-AttachVolumeTestJSON-389116424 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e32d441c-cdd5-409d-8a58-42a930632d90', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'e32d441c-cdd5-409d-8a58-42a930632d90', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:21:26.047688 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-b29b9157-be84-4709-8afe-3444bc848d92 req-5db7d9da-5c51-4ac0-96d0-9cf9a1c1b6ff tempest-AttachVolumeTestJSON-389116424 None] Connection info returned from driver {'name': 'volumes/volume-e32d441c-cdd5-409d-8a58-42a930632d90', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e32d441c-cdd5-409d-8a58-42a930632d90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '80c3025a-80fa-4c18-9770-9ace4a29764e'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:21:26.138043 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-b29b9157-be84-4709-8afe-3444bc848d92 req-5db7d9da-5c51-4ac0-96d0-9cf9a1c1b6ff tempest-AttachVolumeTestJSON-389116424 None] attachment_update completed successfully. Nov 10 04:21:28.555903 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:21:28.557758 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:28.621422 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:28.674851 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:28.723943 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:21:28.731595 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:21:28.732094 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:21:28.752332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Flow 'volume_create_manager' (031f5e6b-8d4c-4330-9e60-5312d7563358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:28.756946 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a1fba-9c11-4c4a-98c1-a48374c91a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:28.786824 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:21:28.809716 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a1fba-9c11-4c4a-98c1-a48374c91a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-981981016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=07cea8df-35b0-474d-be33-ebc231b4aeb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a2ec0afddf403183d9d44778510b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:21:29Z,use_quota=True,user_id='694bd6d882cd4099b51d58a50f6f1ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:28.814163 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127bbd6d-f6fb-4426-8084-6463a07dd06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:28.818841 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127bbd6d-f6fb-4426-8084-6463a07dd06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:28.823227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6aacf4-b700-44d8-a772-9e2a8b3ba31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:28.826083 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6aacf4-b700-44d8-a772-9e2a8b3ba31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cea8df-35b0-474d-be33-ebc231b4aeb5', 'volume_name': 'volume-07cea8df-35b0-474d-be33-ebc231b4aeb5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:28.830984 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b290ed-44cd-4f64-a8e7-cd18b0944c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:28.833691 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b290ed-44cd-4f64-a8e7-cd18b0944c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:28.836529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34584bb-9334-4f82-acaf-43d99da55371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:28.838286 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Volume 07cea8df-35b0-474d-be33-ebc231b4aeb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cea8df-35b0-474d-be33-ebc231b4aeb5', 'volume_size': 1} Nov 10 04:21:28.838711 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] creating volume 'volume-07cea8df-35b0-474d-be33-ebc231b4aeb5' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:21:28.840119 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:28.988208 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:21:28.988783 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:21:28.990797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34584bb-9334-4f82-acaf-43d99da55371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cea8df-35b0-474d-be33-ebc231b4aeb5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:28.992965 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc2b2ed-4394-4ae9-95d9-b2922af711a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:29.003213 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Volume volume-07cea8df-35b0-474d-be33-ebc231b4aeb5 (07cea8df-35b0-474d-be33-ebc231b4aeb5): created successfully Nov 10 04:21:29.006049 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc2b2ed-4394-4ae9-95d9-b2922af711a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:29.009876 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Flow 'volume_create_manager' (031f5e6b-8d4c-4330-9e60-5312d7563358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:29.019646 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1b74dc3a-c8cd-4ef8-80c9-2987705f76ca tempest-AttachVolumeTestJSON-389116424 None] Created volume successfully. Nov 10 04:21:30.224797 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-de885818-b84e-40a4-a89e-851024088ea4 req-ca0e1615-87cd-44c1-9491-118db192b4c7 tempest-AttachVolumeTestJSON-389116424 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:21:31.052540 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-de885818-b84e-40a4-a89e-851024088ea4 req-ca0e1615-87cd-44c1-9491-118db192b4c7 tempest-AttachVolumeTestJSON-389116424 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.828s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:21:31.053412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-de885818-b84e-40a4-a89e-851024088ea4 req-ca0e1615-87cd-44c1-9491-118db192b4c7 tempest-AttachVolumeTestJSON-389116424 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-07cea8df-35b0-474d-be33-ebc231b4aeb5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '07cea8df-35b0-474d-be33-ebc231b4aeb5', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:21:31.087342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-de885818-b84e-40a4-a89e-851024088ea4 req-ca0e1615-87cd-44c1-9491-118db192b4c7 tempest-AttachVolumeTestJSON-389116424 None] Connection info returned from driver {'name': 'volumes/volume-07cea8df-35b0-474d-be33-ebc231b4aeb5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '07cea8df-35b0-474d-be33-ebc231b4aeb5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7d663f70-9583-4cf6-8ea3-c2922d44a672'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:21:31.195319 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-de885818-b84e-40a4-a89e-851024088ea4 req-ca0e1615-87cd-44c1-9491-118db192b4c7 tempest-AttachVolumeTestJSON-389116424 None] attachment_update completed successfully. Nov 10 04:21:34.601288 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-6719801b-7c20-49b8-82b9-fae0c68a189a req-b8f9a87c-a6ef-4926-aacd-eba9b7e9307e tempest-AttachVolumeTestJSON-389116424 None] Terminate volume connection completed successfully. Nov 10 04:21:34.603122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-6719801b-7c20-49b8-82b9-fae0c68a189a req-b8f9a87c-a6ef-4926-aacd-eba9b7e9307e tempest-AttachVolumeTestJSON-389116424 None] Deleting attachment 80c3025a-80fa-4c18-9770-9ace4a29764e. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:21:36.021589 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-78045e7c-1a7d-4f11-b2fd-996d8ae92688 req-dbf2b09e-e3c3-492e-b107-dda60f0ac4b7 tempest-AttachVolumeTestJSON-389116424 None] Terminate volume connection completed successfully. Nov 10 04:21:36.023015 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-78045e7c-1a7d-4f11-b2fd-996d8ae92688 req-dbf2b09e-e3c3-492e-b107-dda60f0ac4b7 tempest-AttachVolumeTestJSON-389116424 None] Deleting attachment 7d663f70-9583-4cf6-8ea3-c2922d44a672. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:21:39.446196 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-03b234e9-4457-4470-982a-db34d0c0ded6 tempest-GroupSnapshotsTest-703096771 None] Group tempest-GroupSnapshotsTest-Group-992957799: creating Nov 10 04:21:39.474098 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-03b234e9-4457-4470-982a-db34d0c0ded6 tempest-GroupSnapshotsTest-703096771 None] Group tempest-GroupSnapshotsTest-Group-992957799: created successfully Nov 10 04:21:39.486939 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-03b234e9-4457-4470-982a-db34d0c0ded6 tempest-GroupSnapshotsTest-703096771 None] Create group completed successfully. Nov 10 04:21:41.238038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:21:41.244578 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:21:41.244972 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:21:41.261700 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (c98051ba-3abf-4975-affa-adef8b08c7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:41.268735 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e2717-92e2-4f2f-b615-ff8427c481f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:41.279800 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:21:41.304235 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e2717-92e2-4f2f-b615-ff8427c481f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1162369754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c86208-6d4e-4e01-9ce9-da79c1e07711,host='ncdv-817176-1@ceph#ceph',id=607479ec-a061-4192-ba5b-07838e8a8a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ed2d7c01b6441f9e0b1cca0d272c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:21:41Z,use_quota=True,user_id='ae9d7f5f1d3b4665b8865e4d9aa6020b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bf3e309-75a8-4e38-aaaf-5455ed91cae8),volume_type_id=9bf3e309-75a8-4e38-aaaf-5455ed91cae8)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:41.308510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11665183-14d2-4ed1-b1d0-08e1a1ba1d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:41.313124 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11665183-14d2-4ed1-b1d0-08e1a1ba1d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:41.317265 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad321d86-5934-4c9e-807d-c6d0f6a2a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:41.320826 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad321d86-5934-4c9e-807d-c6d0f6a2a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607479ec-a061-4192-ba5b-07838e8a8a6a', 'volume_name': 'volume-607479ec-a061-4192-ba5b-07838e8a8a6a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:41.325544 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003fec89-7471-4c31-b23e-f649bc14ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:41.328805 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003fec89-7471-4c31-b23e-f649bc14ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:41.332449 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f087ef2e-b2e4-4d62-963a-3e336b8c9a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:41.376060 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Volume 607479ec-a061-4192-ba5b-07838e8a8a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607479ec-a061-4192-ba5b-07838e8a8a6a', 'volume_size': 1} Nov 10 04:21:41.376825 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] creating volume 'volume-607479ec-a061-4192-ba5b-07838e8a8a6a' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:21:41.378484 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:41.493887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:21:41.494633 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:21:41.498745 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f087ef2e-b2e4-4d62-963a-3e336b8c9a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607479ec-a061-4192-ba5b-07838e8a8a6a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:41.503375 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b94fad8-d15a-4b42-ac14-b516411c57e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:41.517445 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Volume volume-607479ec-a061-4192-ba5b-07838e8a8a6a (607479ec-a061-4192-ba5b-07838e8a8a6a): created successfully Nov 10 04:21:41.520557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b94fad8-d15a-4b42-ac14-b516411c57e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:41.523760 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (c98051ba-3abf-4975-affa-adef8b08c7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:41.532587 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4d43502e-3bbe-402b-81df-a50b4fe331c2 tempest-GroupSnapshotsTest-703096771 None] Created volume successfully. Nov 10 04:21:42.715221 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-038a2c5d-afcd-46e6-bbea-281a84657fda tempest-GroupSnapshotsTest-703096771 None] GroupSnapshot 16573af8-f5ce-4b50-8cd5-caf3011c5882: creating. Nov 10 04:21:42.780012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038a2c5d-afcd-46e6-bbea-281a84657fda tempest-GroupSnapshotsTest-703096771 None] Group snapshot 16573af8-f5ce-4b50-8cd5-caf3011c5882: creating. {{(pid=127842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 10 04:21:42.839713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-038a2c5d-afcd-46e6-bbea-281a84657fda tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:44.229105 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-038a2c5d-afcd-46e6-bbea-281a84657fda tempest-GroupSnapshotsTest-703096771 None] group_snapshot 16573af8-f5ce-4b50-8cd5-caf3011c5882: created successfully Nov 10 04:21:45.962755 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-976f9971-d288-469a-8bce-c9d7c8ca7e78 tempest-GroupSnapshotsTest-703096771 None] cloning volumes/volume-607479ec-a061-4192-ba5b-07838e8a8a6a@snapshot-155b6314-7464-4b30-8da0-5b53a9e17bb1 to volume-06740652-50ac-4401-9133-00fe5568fca9 {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:21:45.964475 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-976f9971-d288-469a-8bce-c9d7c8ca7e78 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:46.082456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-976f9971-d288-469a-8bce-c9d7c8ca7e78 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:46.179751 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] Lock "b'cinder-07cea8df-35b0-474d-be33-ebc231b4aeb5-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:21:46.260100 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:46.405605 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:21:46.406646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] Volume volume-07cea8df-35b0-474d-be33-ebc231b4aeb5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:21:46.426394 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] deleting rbd volume volume-07cea8df-35b0-474d-be33-ebc231b4aeb5 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:46.455227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-976f9971-d288-469a-8bce-c9d7c8ca7e78 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:21:46.461199 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-976f9971-d288-469a-8bce-c9d7c8ca7e78 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:21:46.583917 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-976f9971-d288-469a-8bce-c9d7c8ca7e78 tempest-GroupSnapshotsTest-703096771 None] Create group from source-snapshot-16573af8-f5ce-4b50-8cd5-caf3011c5882 completed successfully. Nov 10 04:21:47.201474 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] Created reservations ['8fcee15f-f509-4671-9285-56de49cb867e', 'e4fbc392-a27b-48c1-9837-7d66d4d4bfe5', 'a842fbb8-e877-4532-bfd5-ed65854e5869', '89ca24a4-9f67-4872-9672-76077b7a6ef7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:47.329025 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:47.426062 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:47.497531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:47.513372 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] Deleted volume successfully. Nov 10 04:21:47.580728 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] Lock "b'cinder-e32d441c-cdd5-409d-8a58-42a930632d90-delete_volume'" acquired by "delete_volume" :: waited 0.077s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:21:47.617697 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e859abf9-f7df-4887-959f-ab04ef5eda26 tempest-AttachVolumeTestJSON-389116424 None] Lock "b'cinder-07cea8df-35b0-474d-be33-ebc231b4aeb5-delete_volume'" released by "delete_volume" :: held 1.438s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:21:47.678525 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:47.747505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:21:47.747935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] Volume volume-e32d441c-cdd5-409d-8a58-42a930632d90 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:21:47.775244 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] deleting rbd volume volume-e32d441c-cdd5-409d-8a58-42a930632d90 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:47.943889 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:48.083320 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:21:48.094675 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] deleting rbd volume volume-06740652-50ac-4401-9133-00fe5568fca9 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:48.363372 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] Created reservations ['2681a395-afb0-4d36-96e7-0130d6e97659', '838dcea3-d5cd-4bae-981d-8ebf8f915cfe', '6e65ab39-fc4f-4986-8e73-46ca9515c58f', 'd6f872d0-a119-416f-bdb6-6ea0e644d13e'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:48.438759 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:48.490823 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:48.532369 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:48.559294 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] Deleted volume successfully. Nov 10 04:21:48.619108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-8efefe88-e7d5-4113-b8a8-4bb4bc47ded0 tempest-AttachVolumeTestJSON-389116424 None] Lock "b'cinder-e32d441c-cdd5-409d-8a58-42a930632d90-delete_volume'" released by "delete_volume" :: held 1.036s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:21:48.646192 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['f500164b-686c-4c63-8b62-e585c0570ef1'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:48.689400 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-129450477 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-129450477, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:21:48.690634 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-129450477 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-129450477, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:21:48.747461 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['41c6ab87-451b-44e2-9be7-dd314991fc71', 'c834f972-4e50-44eb-8b18-e6a72d4bc636', 'f5a95254-2d86-430b-b5ed-14ff90b6f63c', 'ff49a0a7-7550-4487-b857-d0c0649fa3c4'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:48.930826 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] Lock "b'cinder-7d20e82a-774c-445b-a4ea-103f5a2cde44-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:21:49.009168 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:49.130575 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:49.191802 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:49.198275 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-944572b3-af3d-49c9-8a45-1fcd4a865b09 tempest-GroupSnapshotsTest-703096771 None] Delete group completed successfully. Nov 10 04:21:49.205301 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:49.308476 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:21:49.308931 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] Volume volume-7d20e82a-774c-445b-a4ea-103f5a2cde44 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:21:49.324482 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] deleting rbd volume volume-7d20e82a-774c-445b-a4ea-103f5a2cde44 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:49.329142 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-eb52d3a1-2538-4ac0-8eb5-c09705891b67 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 16573af8-f5ce-4b50-8cd5-caf3011c5882: deleting Nov 10 04:21:49.361507 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-eb52d3a1-2538-4ac0-8eb5-c09705891b67 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 16573af8-f5ce-4b50-8cd5-caf3011c5882: deleting {{(pid=127842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 10 04:21:49.393104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-eb52d3a1-2538-4ac0-8eb5-c09705891b67 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:49.676463 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] Created reservations ['d2a71d32-3022-42ff-828e-fac3579f30a9', '1bc22ff1-cc3c-49ca-aece-d937b073b251', '534199ce-fe5e-46c4-a239-d5dbdc92bf54', 'd5dd4ca0-f068-434a-b51c-1d9988a75886'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:49.762437 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:49.817045 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:49.851368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:49.862647 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] Deleted volume successfully. Nov 10 04:21:49.883666 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-854d12a6-5f69-46c4-8aab-d60bfaf49713 tempest-AttachVolumeTestJSON-389116424 None] Lock "b'cinder-7d20e82a-774c-445b-a4ea-103f5a2cde44-delete_volume'" released by "delete_volume" :: held 0.953s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:21:49.914774 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-eb52d3a1-2538-4ac0-8eb5-c09705891b67 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-129450477 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-129450477, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:21:49.930955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-eb52d3a1-2538-4ac0-8eb5-c09705891b67 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['2945ed5b-fb73-4855-8925-9e5abc9f366a', 'deda5e18-fa5c-4651-bdcd-b027b65623c4', '3e510937-8325-40ea-8686-18caf06ec130', '4791e343-a2aa-4b41-a9a5-d9a28f1fa3d7'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:50.011544 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-eb52d3a1-2538-4ac0-8eb5-c09705891b67 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 16573af8-f5ce-4b50-8cd5-caf3011c5882: deleted successfully Nov 10 04:21:50.413944 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-d24905d7-f57b-4366-856c-e5aa1f397552 req-8af8eec5-ebb8-4e94-9e02-35afe9f085ea tempest-TestVolumeBackupRestore-697980072 None] Terminate volume connection completed successfully. Nov 10 04:21:50.415053 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-d24905d7-f57b-4366-856c-e5aa1f397552 req-8af8eec5-ebb8-4e94-9e02-35afe9f085ea tempest-TestVolumeBackupRestore-697980072 None] Deleting attachment 30f732c4-86d4-41c6-8fb4-570fc159af7c. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:21:50.932887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:51.041670 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:21:51.042556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] Volume volume-607479ec-a061-4192-ba5b-07838e8a8a6a is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:21:51.057976 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] deleting rbd volume volume-607479ec-a061-4192-ba5b-07838e8a8a6a {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:51.441460 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['e2b47bc5-9dd1-4cc4-b7be-162c5691238b'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:51.475429 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.db.sqlalchemy.api [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-129450477'] Nov 10 04:21:51.479052 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['b2414d71-867a-422c-b873-c235a21a23a2', 'd66304da-cf55-46ca-bf2e-fb6f47bd5bcc', 'd1459e03-74ae-454a-8ab6-8036cae6c49f', 'e11b891c-84db-4604-b3b5-3fc734a908f5'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:51.559805 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:51.599703 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:51.650540 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:51.658724 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b1223e1b-1db1-45a2-a455-1ca6cce55fc2 tempest-GroupSnapshotsTest-703096771 None] Delete group completed successfully. Nov 10 04:21:52.407845 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3ff1f3f7-bb5e-4307-a5c7-df31b87d93a7 tempest-GroupSnapshotsTest-703096771 None] Group tempest-GroupSnapshotsTest-Group-231260863: creating Nov 10 04:21:52.429586 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3ff1f3f7-bb5e-4307-a5c7-df31b87d93a7 tempest-GroupSnapshotsTest-703096771 None] Group tempest-GroupSnapshotsTest-Group-231260863: created successfully Nov 10 04:21:52.466804 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3ff1f3f7-bb5e-4307-a5c7-df31b87d93a7 tempest-GroupSnapshotsTest-703096771 None] Create group completed successfully. Nov 10 04:21:52.685726 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] Lock "b'cinder-b93f994a-1292-4d70-ba76-4630c86e4605-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:21:52.731834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:53.855908 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] Volume volume-b93f994a-1292-4d70-ba76-4630c86e4605 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:21:53.925488 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] deleting rbd volume volume-b93f994a-1292-4d70-ba76-4630c86e4605 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:53.995166 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] Lock "b'cinder-42d63a60-be1b-40a5-b58e-65bd01edd547-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:21:54.074790 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:54.982272 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] deleting rbd volume volume-42d63a60-be1b-40a5-b58e-65bd01edd547 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:21:55.032742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:21:55.039102 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:21:55.039936 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:21:55.061477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (bbf009a8-2be7-43f6-82b4-ae018231073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:55.066708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5265edca-9954-44f0-a0af-3864bd01b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:55.076800 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:21:55.096529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5265edca-9954-44f0-a0af-3864bd01b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1030556563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=249cbb98-0b8f-42e9-b6ff-58dca988ff9e,host='ncdv-817176-1@ceph#ceph',id=5b8ee948-4cbe-480b-80ba-91fc1f8121f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ed2d7c01b6441f9e0b1cca0d272c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:21:54Z,use_quota=True,user_id='ae9d7f5f1d3b4665b8865e4d9aa6020b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f630f1e7-1340-402b-a5a4-3b0a684bb2e7),volume_type_id=f630f1e7-1340-402b-a5a4-3b0a684bb2e7)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:55.100548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d41e1f-c2dc-44a2-b004-2a448fbb2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:55.103472 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d41e1f-c2dc-44a2-b004-2a448fbb2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:55.116689 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b28d1fd-0574-47f6-b7b9-0b171861cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:55.122559 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b28d1fd-0574-47f6-b7b9-0b171861cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8ee948-4cbe-480b-80ba-91fc1f8121f8', 'volume_name': 'volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:55.127578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503ce552-3fb0-405b-a881-8b350a196c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:55.131791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503ce552-3fb0-405b-a881-8b350a196c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:55.135693 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8775c73-879f-46e0-b12f-a3c3f9742c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:55.173714 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Volume 5b8ee948-4cbe-480b-80ba-91fc1f8121f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8', 'volume_size': 1} Nov 10 04:21:55.174545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] creating volume 'volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:21:55.175747 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:55.300773 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:21:55.301286 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:21:55.306052 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8775c73-879f-46e0-b12f-a3c3f9742c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:55.313419 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627e7afa-4e30-42c8-95a0-7417383698ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:55.326918 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Volume volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8 (5b8ee948-4cbe-480b-80ba-91fc1f8121f8): created successfully Nov 10 04:21:55.329739 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627e7afa-4e30-42c8-95a0-7417383698ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:55.337736 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (bbf009a8-2be7-43f6-82b4-ae018231073c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:55.357538 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5eb6a783-0dce-436b-ad4d-630e1dfd5835 tempest-GroupSnapshotsTest-703096771 None] Created volume successfully. Nov 10 04:21:55.360996 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] Created reservations ['c0131ed2-ec96-4cc7-9c82-82034c786cdb', 'd0c19733-c54c-4390-9650-8a647ea1716b', 'b0c13af8-041d-4af9-bb6d-105d0ec0a980', '3e75ee96-ec1d-415e-a99f-369f7aa46073'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:55.406244 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:21:55.449298 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] deleting parent snapshot volume-42d63a60-be1b-40a5-b58e-65bd01edd547.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:21:56.056816 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:56.126904 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:56.184643 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:56.205537 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] Deleted volume successfully. Nov 10 04:21:56.236143 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] Created reservations ['1dc99e1c-8b56-4e87-aa3f-04eb3029e002', 'c9b951d0-6fc8-4fa0-b8f7-bc2ae81f5e36', '1de7ea42-c47a-460d-b449-544c87f5d20a', 'd3988a3c-f66c-4467-819d-b1eab39a1e4d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:21:56.242245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-317691fa-6a90-4882-b62e-21c050800194 tempest-TestVolumeBackupRestore-697980072 None] Lock "b'cinder-b93f994a-1292-4d70-ba76-4630c86e4605-delete_volume'" released by "delete_volume" :: held 3.557s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:21:56.360531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:56.457647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:56.487398 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:21:56.495858 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] Deleted volume successfully. Nov 10 04:21:56.518960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-def7b82f-52bf-4337-914e-67eb2ae8a76b tempest-TestVolumeBackupRestore-697980072 None] Lock "b'cinder-42d63a60-be1b-40a5-b58e-65bd01edd547-delete_volume'" released by "delete_volume" :: held 2.526s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:21:56.917219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:21:56.922447 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:21:56.923107 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:21:56.937284 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (085d7667-54c5-4175-bb4d-0c364926a6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:56.941368 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f106627-5cc3-4d31-b4fc-0934a90e99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:56.948397 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:21:56.963603 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f106627-5cc3-4d31-b4fc-0934a90e99aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1011094437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=249cbb98-0b8f-42e9-b6ff-58dca988ff9e,host='ncdv-817176-1@ceph#ceph',id=d2998ab1-be6f-4f4f-899d-76db4acd9113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ed2d7c01b6441f9e0b1cca0d272c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:21:57Z,use_quota=True,user_id='ae9d7f5f1d3b4665b8865e4d9aa6020b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f630f1e7-1340-402b-a5a4-3b0a684bb2e7),volume_type_id=f630f1e7-1340-402b-a5a4-3b0a684bb2e7)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:56.968401 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5304394-bee2-4260-a5a9-d7fb0eb0ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:56.971283 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5304394-bee2-4260-a5a9-d7fb0eb0ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:56.974268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9020f80-46dc-4bb7-a5ca-81fca475cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:56.976506 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9020f80-46dc-4bb7-a5ca-81fca475cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2998ab1-be6f-4f4f-899d-76db4acd9113', 'volume_name': 'volume-d2998ab1-be6f-4f4f-899d-76db4acd9113', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:56.979383 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d69287-e597-471a-8193-ee9ec8403eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:56.981708 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d69287-e597-471a-8193-ee9ec8403eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:56.984479 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d6ffc7-c29a-4ebd-9074-41f13c192154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:57.015284 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Volume d2998ab1-be6f-4f4f-899d-76db4acd9113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2998ab1-be6f-4f4f-899d-76db4acd9113', 'volume_size': 1} Nov 10 04:21:57.016176 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] creating volume 'volume-d2998ab1-be6f-4f4f-899d-76db4acd9113' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:21:57.017448 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:21:57.110978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:21:57.112064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:21:57.114800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d6ffc7-c29a-4ebd-9074-41f13c192154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2998ab1-be6f-4f4f-899d-76db4acd9113', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:57.117543 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da3487f-6e29-4f11-9cf9-20025a07e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:21:57.130120 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Volume volume-d2998ab1-be6f-4f4f-899d-76db4acd9113 (d2998ab1-be6f-4f4f-899d-76db4acd9113): created successfully Nov 10 04:21:57.133431 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da3487f-6e29-4f11-9cf9-20025a07e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:21:57.139466 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (085d7667-54c5-4175-bb4d-0c364926a6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:21:57.153354 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3b8ce804-9e4c-41e1-8b75-ef63d3086df6 tempest-GroupSnapshotsTest-703096771 None] Created volume successfully. Nov 10 04:21:58.116357 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-bc91f8e6-aed8-4c96-99f1-b6edeffecc64 tempest-GroupSnapshotsTest-703096771 None] Update group completed successfully. Nov 10 04:21:59.418380 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b5bee32b-4db3-4da5-9c81-1d63ff1e83f7 tempest-GroupSnapshotsTest-703096771 None] Update group completed successfully. Nov 10 04:22:00.569140 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0e7b1e39-0277-4f90-aa22-0d504385f573 tempest-GroupSnapshotsTest-703096771 None] Update group completed successfully. Nov 10 04:22:01.846846 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-265969c9-10ae-4d47-9d2b-f19cb8bba968 tempest-GroupSnapshotsTest-703096771 None] Update group completed successfully. Nov 10 04:22:03.368557 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-aa29cabd-3b9b-4914-8d60-2b2bea9d9aeb tempest-GroupSnapshotsTest-703096771 None] GroupSnapshot a4999939-c386-400d-9612-6c1dd0898928: creating. Nov 10 04:22:03.428003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-aa29cabd-3b9b-4914-8d60-2b2bea9d9aeb tempest-GroupSnapshotsTest-703096771 None] Group snapshot a4999939-c386-400d-9612-6c1dd0898928: creating. {{(pid=127842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 10 04:22:03.491175 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aa29cabd-3b9b-4914-8d60-2b2bea9d9aeb tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:04.154400 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-aa29cabd-3b9b-4914-8d60-2b2bea9d9aeb tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:04.516437 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2bbe4987-8d1a-43ae-a76d-d5a86f477c1a tempest-GroupsTest-1806750668 None] Group tempest-Group1-1519330161: creating Nov 10 04:22:04.551062 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2bbe4987-8d1a-43ae-a76d-d5a86f477c1a tempest-GroupsTest-1806750668 None] Group tempest-Group1-1519330161: created successfully Nov 10 04:22:04.564640 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2bbe4987-8d1a-43ae-a76d-d5a86f477c1a tempest-GroupsTest-1806750668 None] Create group completed successfully. Nov 10 04:22:05.319948 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-aa29cabd-3b9b-4914-8d60-2b2bea9d9aeb tempest-GroupSnapshotsTest-703096771 None] group_snapshot a4999939-c386-400d-9612-6c1dd0898928: created successfully Nov 10 04:22:05.724737 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] group_snapshot a4999939-c386-400d-9612-6c1dd0898928: deleting Nov 10 04:22:05.771579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] group_snapshot a4999939-c386-400d-9612-6c1dd0898928: deleting {{(pid=127842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 10 04:22:05.814552 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:05.949355 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-69ed18bb-326a-4335-a997-bf4088401cba tempest-GroupsTest-1806750668 None] Group tempest-Group2-1231137664: creating Nov 10 04:22:05.997729 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-69ed18bb-326a-4335-a997-bf4088401cba tempest-GroupsTest-1806750668 None] Group tempest-Group2-1231137664: created successfully Nov 10 04:22:06.025101 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-69ed18bb-326a-4335-a997-bf4088401cba tempest-GroupsTest-1806750668 None] Create group completed successfully. Nov 10 04:22:06.190065 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:07.205038 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-895197366 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-895197366, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:07.205987 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-895197366 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-895197366, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:07.224676 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['2deaeffa-7949-4c7e-96b9-ffa9883840d9', '86cea06a-6560-41d7-8303-980a49ce4206', 'a8608ceb-9d95-4414-bbb3-6b68f62750dc', '86b87400-32e5-4ae9-a380-4d9bc7f5f1cd'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:07.322543 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['c48c51be-268b-4b90-b13e-63affd56b940', 'fc71fc18-3891-45b9-8ec1-12ef74323160', '3e3b4021-61a2-4a5d-a40a-d4cd4ef9524d', 'a89719d4-3807-4c42-a8f3-ccfeb386f782'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:07.415004 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e8b78e9b-26e3-4fa9-a846-ef341bfacf17 tempest-GroupSnapshotsTest-703096771 None] group_snapshot a4999939-c386-400d-9612-6c1dd0898928: deleted successfully Nov 10 04:22:07.500955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:07.501601 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:07.502053 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:07.513974 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Flow 'volume_create_manager' (ad359e98-fae1-4400-8e6b-01dc722e799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:07.517598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58846b72-92f2-4293-a447-255a7e7fc179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:07.529548 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:07.544186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58846b72-92f2-4293-a447-255a7e7fc179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1076835474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e693b4c-5a8b-4467-ac96-66126e62316b,host='ncdv-817176-1@ceph#ceph',id=70e54c86-49d6-416e-adea-f1c72e82049f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe56311d43a41599ccab741fce8fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:07Z,use_quota=True,user_id='2223e4497dc54e88b4092dd8f20d52d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(940d74e4-912f-460e-8767-59d6a0a106e4),volume_type_id=940d74e4-912f-460e-8767-59d6a0a106e4)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:07.547008 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3841cedf-7c1b-49e2-ae51-6f941f102e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:07.549090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3841cedf-7c1b-49e2-ae51-6f941f102e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:07.551403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7590f-2a6a-4ecd-a8cc-f157af0ce629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:07.554292 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7590f-2a6a-4ecd-a8cc-f157af0ce629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e54c86-49d6-416e-adea-f1c72e82049f', 'volume_name': 'volume-70e54c86-49d6-416e-adea-f1c72e82049f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:07.556754 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f5df14-c841-49bb-9fc2-674910eca57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:07.558806 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f5df14-c841-49bb-9fc2-674910eca57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:07.560955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6f9c89-92ad-448c-834d-0f7152389015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:07.583686 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Volume 70e54c86-49d6-416e-adea-f1c72e82049f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e54c86-49d6-416e-adea-f1c72e82049f', 'volume_size': 1} Nov 10 04:22:07.584587 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] creating volume 'volume-70e54c86-49d6-416e-adea-f1c72e82049f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:07.586071 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:07.733885 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:07.734601 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:07.736954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6f9c89-92ad-448c-834d-0f7152389015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e54c86-49d6-416e-adea-f1c72e82049f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:07.740032 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcbd841-6ae8-4c1b-ab33-66f77b0dd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:07.756219 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Volume volume-70e54c86-49d6-416e-adea-f1c72e82049f (70e54c86-49d6-416e-adea-f1c72e82049f): created successfully Nov 10 04:22:07.761007 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcbd841-6ae8-4c1b-ab33-66f77b0dd26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:07.767742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Flow 'volume_create_manager' (ad359e98-fae1-4400-8e6b-01dc722e799a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:07.785960 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-53af982c-eabf-4d8c-b4a0-1e0811f8e69e tempest-GroupsTest-1806750668 None] Created volume successfully. Nov 10 04:22:08.538098 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:08.640429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:08.640909 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Volume volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:08.654567 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] deleting rbd volume volume-5b8ee948-4cbe-480b-80ba-91fc1f8121f8 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:09.043549 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:09.110831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:09.111547 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Volume volume-d2998ab1-be6f-4f4f-899d-76db4acd9113 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:09.119647 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] deleting rbd volume volume-d2998ab1-be6f-4f4f-899d-76db4acd9113 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:09.253923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:09.327922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:09.328847 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Volume volume-70e54c86-49d6-416e-adea-f1c72e82049f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:09.340556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] deleting rbd volume volume-70e54c86-49d6-416e-adea-f1c72e82049f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:09.580369 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Created reservations ['0e748b50-d9a2-45e2-b647-54f814017515'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:09.620733 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-895197366 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-895197366, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:09.648927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Created reservations ['175d664e-45f7-406f-b9c4-80e15f83f9c8', 'e0864fff-dd5a-4245-a0e5-66460fa7fa9e', 'a71d949b-1696-4259-a4a7-502b569fd02e', '15523ff5-de5b-423e-b1a3-fb8f960f2a18'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:09.835834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Created reservations ['b141c513-d58f-4622-8fc6-a1e5674a2657'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:09.843737 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Created reservations ['e1d4bb3b-7f01-4e59-a0fd-5838721e6fbb', 'ef167572-cd57-47d5-aae1-ef101a08ae48', 'a64fefdd-46e1-48c1-acd1-d984c25f3d89', '15975b3e-6ba2-4ff3-9aa6-c85bc97ab2f4'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:09.870614 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1122854566 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1122854566, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:09.871504 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1122854566 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1122854566, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:09.897965 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Created reservations ['4670a097-ea6f-4698-bf5e-c550701c74bd', '9910569d-6d7a-4690-8564-988987a66f53', '1ceecc43-33f6-492e-8b72-17a1d74cc366', 'dd71ec2c-76a8-4534-99f2-a85960d91c14'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:09.970975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:10.024816 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:10.059807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:10.068151 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-65c01c92-6696-41a8-b32d-0671587559ea tempest-GroupSnapshotsTest-703096771 None] Delete group completed successfully. Nov 10 04:22:10.122305 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:10.163073 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:10.211660 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:10.215963 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2033f73e-7279-496a-a0a8-972bcbedd53d tempest-GroupsTest-1806750668 None] Delete group completed successfully. Nov 10 04:22:10.554613 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-1d9a8b85-5d33-49dd-8a99-a8f390e46794 tempest-GroupsTest-1806750668 None] Created reservations ['6d955151-0b7d-4d41-b3e9-7184001778b0'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:10.600638 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1d9a8b85-5d33-49dd-8a99-a8f390e46794 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:10.645399 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1d9a8b85-5d33-49dd-8a99-a8f390e46794 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:10.711807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-1d9a8b85-5d33-49dd-8a99-a8f390e46794 tempest-GroupsTest-1806750668 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:10.718746 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1d9a8b85-5d33-49dd-8a99-a8f390e46794 tempest-GroupsTest-1806750668 None] Delete group completed successfully. Nov 10 04:22:11.194807 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cf1b597d-c8b8-4898-9057-bf93a1a052d7 tempest-GroupSnapshotsTest-703096771 None] Group tempest-GroupSnapshotsTest-Group-1472878057: creating Nov 10 04:22:11.212081 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cf1b597d-c8b8-4898-9057-bf93a1a052d7 tempest-GroupSnapshotsTest-703096771 None] Group tempest-GroupSnapshotsTest-Group-1472878057: created successfully Nov 10 04:22:11.221671 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cf1b597d-c8b8-4898-9057-bf93a1a052d7 tempest-GroupSnapshotsTest-703096771 None] Create group completed successfully. Nov 10 04:22:12.052445 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e93334d7-0580-47d7-b73b-8e9b30edea19 tempest-GroupsTest-1806750668 None] Group tempest-GroupsTest-Group-1017416194: creating Nov 10 04:22:12.079061 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e93334d7-0580-47d7-b73b-8e9b30edea19 tempest-GroupsTest-1806750668 None] Group tempest-GroupsTest-Group-1017416194: created successfully Nov 10 04:22:12.090701 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e93334d7-0580-47d7-b73b-8e9b30edea19 tempest-GroupsTest-1806750668 None] Create group completed successfully. Nov 10 04:22:12.603922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:12.607698 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:12.608901 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:12.621392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (58992f96-f45a-49aa-a64c-a126f81add3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:12.625314 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9e11d0-d9f5-444b-8f8e-df189b24e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:12.631430 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:12.643863 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9e11d0-d9f5-444b-8f8e-df189b24e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-647760708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5088b963-67cd-473f-9017-f94af2c056a9,host='ncdv-817176-1@ceph#ceph',id=07710f80-5a0c-4ff9-9916-44de8e2e5ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ed2d7c01b6441f9e0b1cca0d272c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:13Z,use_quota=True,user_id='ae9d7f5f1d3b4665b8865e4d9aa6020b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df51386f-abff-4a97-bce4-85ecadfe15d0),volume_type_id=df51386f-abff-4a97-bce4-85ecadfe15d0)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:12.646775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759f0353-daaa-4dd2-8b37-e284ef7d6e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:12.648974 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759f0353-daaa-4dd2-8b37-e284ef7d6e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:12.651489 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0a0bdb-d5b0-4e6d-a259-bf6a93d5c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:12.653682 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0a0bdb-d5b0-4e6d-a259-bf6a93d5c682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07710f80-5a0c-4ff9-9916-44de8e2e5ac0', 'volume_name': 'volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:12.656536 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce2bab-0a63-47a3-b0e3-a6e10f6e1e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:12.658769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce2bab-0a63-47a3-b0e3-a6e10f6e1e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:12.661011 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd5c7a9-1375-42ac-853d-804f593eb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:12.675614 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Volume 07710f80-5a0c-4ff9-9916-44de8e2e5ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0', 'volume_size': 1} Nov 10 04:22:12.676218 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] creating volume 'volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:12.677256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:12.740056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:12.740579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:12.743644 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd5c7a9-1375-42ac-853d-804f593eb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:12.746193 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68528bbe-fcfd-4ae0-ab53-6068ab0d67e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:12.757269 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Volume volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0 (07710f80-5a0c-4ff9-9916-44de8e2e5ac0): created successfully Nov 10 04:22:12.759662 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68528bbe-fcfd-4ae0-ab53-6068ab0d67e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:12.762958 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Flow 'volume_create_manager' (58992f96-f45a-49aa-a64c-a126f81add3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:12.772109 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-249dff2e-6bd5-43fa-9c8d-40e16c39f5a3 tempest-GroupSnapshotsTest-703096771 None] Created volume successfully. Nov 10 04:22:13.556045 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:13.559832 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:13.560283 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:13.576221 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Flow 'volume_create_manager' (98009f9d-8edc-417c-86f0-72ad9faf41a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:13.579644 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cee95e1-e258-4992-aabd-70f98a140b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:13.594035 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:13.608986 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cee95e1-e258-4992-aabd-70f98a140b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-35957074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7b28f7f-971a-403a-88e2-c335d06c3a29,host='ncdv-817176-1@ceph#ceph',id=8a6acb12-1320-40c9-acee-557f26f2b688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe56311d43a41599ccab741fce8fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:14Z,use_quota=True,user_id='2223e4497dc54e88b4092dd8f20d52d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(301d863b-2892-4ca7-a98a-f252e68a2cfb),volume_type_id=301d863b-2892-4ca7-a98a-f252e68a2cfb)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:13.611583 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f499e2a-4c2e-4052-824d-10fc0e1a17bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:13.614013 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f499e2a-4c2e-4052-824d-10fc0e1a17bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:13.616446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bb742e-af62-41e6-a7b6-10847efdc5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:13.618901 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bb742e-af62-41e6-a7b6-10847efdc5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6acb12-1320-40c9-acee-557f26f2b688', 'volume_name': 'volume-8a6acb12-1320-40c9-acee-557f26f2b688', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:13.621238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6cc0ad-d773-4873-bfbe-70ec524749f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:13.624407 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6cc0ad-d773-4873-bfbe-70ec524749f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:13.626709 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fbc7c5-41dd-489c-969c-02508c00e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:13.646995 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Volume 8a6acb12-1320-40c9-acee-557f26f2b688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6acb12-1320-40c9-acee-557f26f2b688', 'volume_size': 1} Nov 10 04:22:13.647397 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] creating volume 'volume-8a6acb12-1320-40c9-acee-557f26f2b688' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:13.648443 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:13.731224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:13.731721 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:13.734099 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fbc7c5-41dd-489c-969c-02508c00e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6acb12-1320-40c9-acee-557f26f2b688', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:13.736336 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107600da-62fe-44b0-958e-3b018a511712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:13.746469 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Volume volume-8a6acb12-1320-40c9-acee-557f26f2b688 (8a6acb12-1320-40c9-acee-557f26f2b688): created successfully Nov 10 04:22:13.750346 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107600da-62fe-44b0-958e-3b018a511712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:13.754664 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Flow 'volume_create_manager' (98009f9d-8edc-417c-86f0-72ad9faf41a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:13.764937 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e1d73e8d-e43e-4847-8a39-f2c071e67122 tempest-GroupsTest-1806750668 None] Created volume successfully. Nov 10 04:22:13.859421 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a5f9ef4-497a-4b00-b455-aaf11a10b232 tempest-GroupSnapshotsTest-703096771 None] GroupSnapshot 5e9ff1f7-56b5-4e52-9214-491989035aa6: creating. Nov 10 04:22:13.880093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-4a5f9ef4-497a-4b00-b455-aaf11a10b232 tempest-GroupSnapshotsTest-703096771 None] Group snapshot 5e9ff1f7-56b5-4e52-9214-491989035aa6: creating. {{(pid=127842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 10 04:22:13.916799 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a5f9ef4-497a-4b00-b455-aaf11a10b232 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:14.201291 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a5f9ef4-497a-4b00-b455-aaf11a10b232 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 5e9ff1f7-56b5-4e52-9214-491989035aa6: created successfully Nov 10 04:22:15.230104 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 5e9ff1f7-56b5-4e52-9214-491989035aa6: deleting Nov 10 04:22:15.251502 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 5e9ff1f7-56b5-4e52-9214-491989035aa6: deleting {{(pid=127842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 10 04:22:15.269870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:15.382014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:15.389903 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:15.391640 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:15.414298 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Flow 'volume_create_manager' (d0b8655a-99fe-43d6-829b-1143bd7b4b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:15.418508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a481764-d291-4d25-a0bc-4b293b7f9a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:15.457849 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:15.485985 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a481764-d291-4d25-a0bc-4b293b7f9a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1027801697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7b28f7f-971a-403a-88e2-c335d06c3a29,host='ncdv-817176-1@ceph#ceph',id=cb595563-4ff0-49b5-9a60-464708809f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe56311d43a41599ccab741fce8fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:15Z,use_quota=True,user_id='2223e4497dc54e88b4092dd8f20d52d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(301d863b-2892-4ca7-a98a-f252e68a2cfb),volume_type_id=301d863b-2892-4ca7-a98a-f252e68a2cfb)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:15.490090 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28306d52-1882-4c20-89a3-2c0a8538db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:15.493648 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28306d52-1882-4c20-89a3-2c0a8538db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:15.500725 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a0431-bbb5-47fb-a440-5b5347f40b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:15.502234 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a0431-bbb5-47fb-a440-5b5347f40b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb595563-4ff0-49b5-9a60-464708809f48', 'volume_name': 'volume-cb595563-4ff0-49b5-9a60-464708809f48', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:15.506220 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a71db71-c179-40d2-8ae3-ac5ba85ade39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:15.508563 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a71db71-c179-40d2-8ae3-ac5ba85ade39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:15.511570 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a0b5ba-e957-45c2-94e7-b965635aeca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:15.530985 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Volume cb595563-4ff0-49b5-9a60-464708809f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb595563-4ff0-49b5-9a60-464708809f48', 'volume_size': 1} Nov 10 04:22:15.532169 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] creating volume 'volume-cb595563-4ff0-49b5-9a60-464708809f48' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:15.533316 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:15.617343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:15.617788 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:15.620680 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a0b5ba-e957-45c2-94e7-b965635aeca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb595563-4ff0-49b5-9a60-464708809f48', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:15.623649 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca93bb18-d601-4d9d-b906-2909640d3e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:15.634498 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Volume volume-cb595563-4ff0-49b5-9a60-464708809f48 (cb595563-4ff0-49b5-9a60-464708809f48): created successfully Nov 10 04:22:15.641200 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca93bb18-d601-4d9d-b906-2909640d3e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:15.644464 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Flow 'volume_create_manager' (d0b8655a-99fe-43d6-829b-1143bd7b4b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:15.654460 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-74417bc6-5c72-46ee-b925-630bf0901312 tempest-GroupsTest-1806750668 None] Created volume successfully. Nov 10 04:22:16.197213 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-144730773 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-144730773, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:16.198361 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-144730773 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-144730773, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:16.214624 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['11ff9f72-b522-4582-80ef-deacd7029a76', '960ceaf9-1b37-4477-afa0-c60969277476', '870b3420-b0d8-4c71-b7e3-8f2fb9b090b2', 'e84bf4a4-5911-47ce-914b-db88f4036175'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:16.269110 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fbc75207-56fe-4c20-a8f4-3ed6e22f1163 tempest-GroupSnapshotsTest-703096771 None] group_snapshot 5e9ff1f7-56b5-4e52-9214-491989035aa6: deleted successfully Nov 10 04:22:16.476753 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d90abd19-0aca-4d75-b2eb-1081f86b86c4 tempest-GroupsTest-1806750668 None] Update group completed successfully. Nov 10 04:22:16.870014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:16.964129 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:16.964653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] Volume volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:16.975057 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] deleting rbd volume volume-07710f80-5a0c-4ff9-9916-44de8e2e5ac0 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:17.311997 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['03dfc7f3-3f11-41bf-9768-c2d2299dcff0'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:17.331137 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-144730773 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-144730773, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:17.352565 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] Created reservations ['1541f7f7-e7df-476b-93ba-b276e863f43b', 'a629cce1-812e-496b-ad9f-0f6f71e6ee2a', '1b4abd95-0919-45ca-91a3-8596582e5b5f', '636bf58b-1178-4442-86f8-41c78f3bd355'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:17.450219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:17.510036 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:17.576134 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:17.581013 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f1f7bdfe-8835-4796-bb3f-8edf5a211378 tempest-GroupSnapshotsTest-703096771 None] Delete group completed successfully. Nov 10 04:22:17.904124 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ed344174-80f2-4fd7-a893-2603c2af95e6 tempest-GroupsTest-1806750668 None] Update group completed successfully. Nov 10 04:22:19.376581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:19.456120 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:19.456596 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Volume volume-8a6acb12-1320-40c9-acee-557f26f2b688 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:19.461966 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] deleting rbd volume volume-8a6acb12-1320-40c9-acee-557f26f2b688 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:19.694002 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:19.752113 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:19.752852 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Volume volume-cb595563-4ff0-49b5-9a60-464708809f48 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:19.760548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] deleting rbd volume volume-cb595563-4ff0-49b5-9a60-464708809f48 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:20.199849 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Created reservations ['b2001b7f-4f90-45c1-8119-988f58c7a321'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:20.244828 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-923469496 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-923469496, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:20.246874 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-923469496 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-923469496, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:20.270164 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Created reservations ['60d8bd3d-2fa1-4d47-ae9d-db5193b7c3c1', 'b2419861-9b3b-432b-b04f-fe7527856c5d', '90cc211d-fb96-4ecc-8f2f-2ce2b02002e0', '737a2820-0451-4e5a-ac09-7f01f789979b'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:20.373883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Created reservations ['234d4c73-773f-40e3-8467-3cea2188db64', '2156d32c-f3c4-49f2-b7f7-b4ef0198508c', '33d7590f-9a4b-483e-ad4e-b1853396fff1', '7eaaac1d-cdfe-4a6d-8f0c-09e460d55606'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:20.499393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:20.579749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:20.634225 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:20.639618 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-298a5c25-b230-4e94-b9d7-76c9c200fb89 tempest-GroupsTest-1806750668 None] Delete group completed successfully. Nov 10 04:22:27.694011 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:27.698269 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:27.699080 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:27.713098 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Flow 'volume_create_manager' (6c62f413-a1e1-40bb-a35b-54f58c21563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:27.717420 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5338eb68-ee6f-453d-b6a1-3ea3adaf33f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:27.724678 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:27.738714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5338eb68-ee6f-453d-b6a1-3ea3adaf33f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1684092147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1d5ddd71-6e52-4896-bcc8-2d73b1ce9005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8308fac50e8442bda594fbf4e1a2f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:28Z,use_quota=True,user_id='cd4a654b819a493f967db187f140cf5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e4dad5c-51e5-4508-854f-2c7c5ab6c07f),volume_type_id=9e4dad5c-51e5-4508-854f-2c7c5ab6c07f)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:27.741791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd892f0a-10e0-49ca-bbf6-5c895b691170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:27.745388 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd892f0a-10e0-49ca-bbf6-5c895b691170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:27.749093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829185b5-2e8d-44b4-853e-9b1a11d61017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:27.751650 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829185b5-2e8d-44b4-853e-9b1a11d61017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5ddd71-6e52-4896-bcc8-2d73b1ce9005', 'volume_name': 'volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:27.754099 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a2613d-2e47-41fe-a916-c1714f4e4de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:27.756522 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a2613d-2e47-41fe-a916-c1714f4e4de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:27.758846 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23262e3b-ed34-4a4b-b893-2454422ebe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:27.759919 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Volume 1d5ddd71-6e52-4896-bcc8-2d73b1ce9005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005', 'volume_size': 1} Nov 10 04:22:27.760704 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] creating volume 'volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:27.761847 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:27.858727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:27.859502 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:27.862273 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23262e3b-ed34-4a4b-b893-2454422ebe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:27.865815 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27030a3f-e577-4dbc-8186-ef4c41a428fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:27.879264 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Volume volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005 (1d5ddd71-6e52-4896-bcc8-2d73b1ce9005): created successfully Nov 10 04:22:27.882472 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27030a3f-e577-4dbc-8186-ef4c41a428fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:27.886833 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Flow 'volume_create_manager' (6c62f413-a1e1-40bb-a35b-54f58c21563d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:27.899855 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-038e6357-4224-46a2-92ac-649c7a79e96d tempest-VolumeTypesAccessTest-1326664107 None] Created volume successfully. Nov 10 04:22:28.553130 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:22:28.554250 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:28.594159 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:28.681592 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:29.107479 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Lock "b'cinder-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:29.179720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:29.258105 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:29.258568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Volume volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:29.269269 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] deleting rbd volume volume-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:29.302400 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:29.313219 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:29.315915 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:29.339454 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Flow 'volume_create_manager' (4aa89f52-868e-46c5-9cc2-6a7a34b00a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:29.342486 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fb03bf-13a2-4349-954f-f53fabf9f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:29.355704 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:29.379807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fb03bf-13a2-4349-954f-f53fabf9f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-687787952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=477aaa67-3557-43c1-8220-81ab6dd1c932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3451e5f5107f48e79d66d4f059f87cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:29Z,use_quota=True,user_id='3a3ff79fd50544bdbec99de25d7b661b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:29.384536 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf01697-7f85-4736-9c64-65c59c4c409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:29.386767 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf01697-7f85-4736-9c64-65c59c4c409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:29.390680 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118f7722-1f2d-4e0b-bd90-825cba98585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:29.394459 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118f7722-1f2d-4e0b-bd90-825cba98585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477aaa67-3557-43c1-8220-81ab6dd1c932', 'volume_name': 'volume-477aaa67-3557-43c1-8220-81ab6dd1c932', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:29.396835 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a0c85c-f63d-4ea7-9303-4922bb0863c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:29.399742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a0c85c-f63d-4ea7-9303-4922bb0863c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:29.402279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d26bbe-0fa6-434e-aaed-82432eb13315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:29.403258 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Volume 477aaa67-3557-43c1-8220-81ab6dd1c932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477aaa67-3557-43c1-8220-81ab6dd1c932', 'volume_size': 1} Nov 10 04:22:29.403830 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] creating volume 'volume-477aaa67-3557-43c1-8220-81ab6dd1c932' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:29.405243 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:29.513791 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:29.514546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:29.517182 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d26bbe-0fa6-434e-aaed-82432eb13315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477aaa67-3557-43c1-8220-81ab6dd1c932', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:29.519671 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e9d623-b66f-4f5e-a66a-a77b2584f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:29.533831 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Volume volume-477aaa67-3557-43c1-8220-81ab6dd1c932 (477aaa67-3557-43c1-8220-81ab6dd1c932): created successfully Nov 10 04:22:29.536183 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e9d623-b66f-4f5e-a66a-a77b2584f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:29.543901 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Flow 'volume_create_manager' (4aa89f52-868e-46c5-9cc2-6a7a34b00a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:29.559504 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-feefb2fa-2cb0-449a-b5b5-b229113cdecb tempest-VolumeQuotasNegativeTestJSON-23446293 None] Created volume successfully. Nov 10 04:22:29.634607 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1546430175 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1546430175, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:29.635655 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1546430175 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1546430175, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:22:29.656220 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Created reservations ['3a0a7b5f-2020-46c2-bfa8-27e053bc4fc1', 'e53af48c-f6e2-4ea0-a6a3-96108b7df87e', 'b56a8514-97e0-4165-8efd-87c0f189e4e6', '4f5b838d-c899-4809-bcb7-0e7385e35e93'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:29.713529 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:29.752754 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:29.816901 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:29.832065 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Deleted volume successfully. Nov 10 04:22:29.848955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a14143ae-b827-4c03-b23b-730f13552127 tempest-VolumeTypesAccessTest-1326664107 None] Lock "b'cinder-1d5ddd71-6e52-4896-bcc8-2d73b1ce9005-delete_volume'" released by "delete_volume" :: held 0.742s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:31.131983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] Lock "b'cinder-477aaa67-3557-43c1-8220-81ab6dd1c932-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:31.191557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:31.253403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:31.254897 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] Volume volume-477aaa67-3557-43c1-8220-81ab6dd1c932 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:31.262386 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] deleting rbd volume volume-477aaa67-3557-43c1-8220-81ab6dd1c932 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:31.589055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] Created reservations ['984d7c41-6ae8-47ac-aa07-899304671cb7', '43286e8d-5e0c-453e-9269-64b997c6ce51', '96470b79-d0cc-46d2-82c2-13eb26542a10', '1ce7bacd-618c-413f-bcad-126a9bdeb833'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:31.642757 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:31.688898 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:31.749911 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:31.758276 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] Deleted volume successfully. Nov 10 04:22:31.771964 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-3fbd4e2a-c486-4fb6-bef6-58b20d2feed5 tempest-VolumeQuotasNegativeTestJSON-23446293 None] Lock "b'cinder-477aaa67-3557-43c1-8220-81ab6dd1c932-delete_volume'" released by "delete_volume" :: held 0.640s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:36.323443 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:36.333697 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:36.334330 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:36.373245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Flow 'volume_create_manager' (d5946944-e8c0-4778-89e6-ab6f8823dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:36.376899 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cd3aeb-7523-4dd6-a5d4-df509502ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:36.386205 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:36.430887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cd3aeb-7523-4dd6-a5d4-df509502ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2055388355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1d999715-b2ea-41e7-85a3-2bf4698a771c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ade3889a1574c768907ec0bfe498090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:36Z,use_quota=True,user_id='ee660a0dc76b4aed93ec701bb1d790cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:36.434519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22624d6-c64e-4a52-95b2-19cd6a4c626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:36.437908 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22624d6-c64e-4a52-95b2-19cd6a4c626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:36.440595 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f3e3b9-ccc2-4d35-b693-fce30a07bbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:36.444207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f3e3b9-ccc2-4d35-b693-fce30a07bbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d999715-b2ea-41e7-85a3-2bf4698a771c', 'volume_name': 'volume-1d999715-b2ea-41e7-85a3-2bf4698a771c', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:36.447322 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2ed723-8c32-4cf6-9339-a84f25ba9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:36.449806 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2ed723-8c32-4cf6-9339-a84f25ba9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:36.453812 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75be84d4-fd61-462a-9b04-f443f6dfe42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:36.454832 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Volume 1d999715-b2ea-41e7-85a3-2bf4698a771c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d999715-b2ea-41e7-85a3-2bf4698a771c', 'volume_size': 1} Nov 10 04:22:36.455410 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] creating volume 'volume-1d999715-b2ea-41e7-85a3-2bf4698a771c' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:36.457020 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:36.575433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:36.576355 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:36.578868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75be84d4-fd61-462a-9b04-f443f6dfe42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d999715-b2ea-41e7-85a3-2bf4698a771c', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:36.581228 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fab9a13-3991-4d79-a653-69ad9a5d4d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:36.595977 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Volume volume-1d999715-b2ea-41e7-85a3-2bf4698a771c (1d999715-b2ea-41e7-85a3-2bf4698a771c): created successfully Nov 10 04:22:36.601587 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fab9a13-3991-4d79-a653-69ad9a5d4d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:36.607881 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Flow 'volume_create_manager' (d5946944-e8c0-4778-89e6-ab6f8823dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:36.632050 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-823ad31d-67df-4fe9-bae2-9708081e3a75 tempest-VolumesMetadataTest-1909104304 None] Created volume successfully. Nov 10 04:22:38.178967 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] Lock "b'cinder-1d999715-b2ea-41e7-85a3-2bf4698a771c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:38.233331 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:38.312775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:38.313283 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] Volume volume-1d999715-b2ea-41e7-85a3-2bf4698a771c is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:38.324544 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] deleting rbd volume volume-1d999715-b2ea-41e7-85a3-2bf4698a771c {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:38.658356 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] Created reservations ['e865cb4d-3d88-4c6a-86ea-d622eacecac9', '945decb8-58cb-4405-a1eb-1e54696c1252', '13a1e628-9202-4664-b3a1-ec02d8adbe0f', '627032c8-3ba6-496d-a99b-b91ef5908fca'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:38.711408 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:38.774279 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:38.843703 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:38.848301 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] Deleted volume successfully. Nov 10 04:22:38.862843 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ab86a1e6-f5bf-4563-81da-300ff78246a6 tempest-VolumesMetadataTest-1909104304 None] Lock "b'cinder-1d999715-b2ea-41e7-85a3-2bf4698a771c-delete_volume'" released by "delete_volume" :: held 0.684s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:42.714394 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:42.718143 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:42.718591 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:42.745411 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Flow 'volume_create_manager' (1bbe8fd0-63ca-4135-a713-e50dbdc26d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:42.749427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f491cbb6-977f-44e3-9b5e-704c05b59bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:42.771941 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:42.793427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f491cbb6-977f-44e3-9b5e-704c05b59bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1573505858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ed4b9a83-6892-4773-a0e4-1afae25a0515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06d60a25afd414080d78d8d06650d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:43Z,use_quota=True,user_id='2b9da6a177b7488885052100aa54830a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:42.797268 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0467c089-1f44-4be9-a4ce-a1dfd5ad8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:42.801903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0467c089-1f44-4be9-a4ce-a1dfd5ad8664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:42.808455 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e839d0-ba87-4e53-a9bf-2057e4cf1f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:42.924231 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e839d0-ba87-4e53-a9bf-2057e4cf1f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed4b9a83-6892-4773-a0e4-1afae25a0515', 'volume_name': 'volume-ed4b9a83-6892-4773-a0e4-1afae25a0515', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:42.926561 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65da4119-9339-49ec-8314-f0dc43ffe190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:42.928712 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65da4119-9339-49ec-8314-f0dc43ffe190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:42.930867 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adea4e8e-aa94-4e6f-831b-e5f0588c4220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:42.931731 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Volume ed4b9a83-6892-4773-a0e4-1afae25a0515: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed4b9a83-6892-4773-a0e4-1afae25a0515', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:22:42.932251 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Cloning ed4b9a83-6892-4773-a0e4-1afae25a0515 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:22:42.960911 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:42.973411 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 22, 42, 965468)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:22:42.973851 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:22:42.974253 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:22:42.980665 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:42.981642 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:22:42.994051 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 22, 42, 988944)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:22:42.994479 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:22:42.994877 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:22:43.009305 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:43.105172 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] creating snapshot='volume-ed4b9a83-6892-4773-a0e4-1afae25a0515.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:22:44.158351 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-ed4b9a83-6892-4773-a0e4-1afae25a0515.clone_snap' to 'volume-ed4b9a83-6892-4773-a0e4-1afae25a0515' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:22:44.226588 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:44.230724 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:44.231196 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:44.249002 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Flow 'volume_create_manager' (bd946947-faf5-4f33-b2f0-b81b0c09076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:44.252878 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4e1404-abb7-4e50-b6fd-4d1509eba5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.260048 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:44.288812 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4e1404-abb7-4e50-b6fd-4d1509eba5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-313956650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=72bfaa9e-4523-4384-92b9-24e76bc0c197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24808a1e4ad448aa8b47953c2db99d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:44Z,use_quota=True,user_id='db173b81e5f747afb7f443d570ae1ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.291709 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2c7cf2-ce81-4040-8cda-1ca4b6a58aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.297779 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2c7cf2-ce81-4040-8cda-1ca4b6a58aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.300692 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f443fcb7-c967-4849-a2b5-53fb0ced8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.303280 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f443fcb7-c967-4849-a2b5-53fb0ced8d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72bfaa9e-4523-4384-92b9-24e76bc0c197', 'volume_name': 'volume-72bfaa9e-4523-4384-92b9-24e76bc0c197', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.306500 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f5eb31-8f04-4e19-a74b-11d4f161748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.327458 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f5eb31-8f04-4e19-a74b-11d4f161748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.331422 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c0d826-590f-494a-a94b-36a9a9671852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.332737 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Volume 72bfaa9e-4523-4384-92b9-24e76bc0c197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72bfaa9e-4523-4384-92b9-24e76bc0c197', 'volume_size': 1} Nov 10 04:22:44.333274 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] creating volume 'volume-72bfaa9e-4523-4384-92b9-24e76bc0c197' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:44.334473 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:44.441293 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:44.443006 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:44.443584 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:44.464112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:22:44.469862 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Marking volume ed4b9a83-6892-4773-a0e4-1afae25a0515 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:22:44.485150 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:44.485531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:44.487547 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c0d826-590f-494a-a94b-36a9a9671852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72bfaa9e-4523-4384-92b9-24e76bc0c197', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.489712 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d783056-86ab-4ecd-bad2-b5ad6ae641e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.493930 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to ed4b9a83-6892-4773-a0e4-1afae25a0515. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:22:44.494366 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Creating volume glance metadata for volume ed4b9a83-6892-4773-a0e4-1afae25a0515 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:22:44.519903 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Volume volume-72bfaa9e-4523-4384-92b9-24e76bc0c197 (72bfaa9e-4523-4384-92b9-24e76bc0c197): created successfully Nov 10 04:22:44.522295 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d783056-86ab-4ecd-bad2-b5ad6ae641e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.525589 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Flow 'volume_create_manager' (bd946947-faf5-4f33-b2f0-b81b0c09076c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:44.542534 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-426432f2-1c31-47bc-be8e-ba9b48681414 tempest-VolumesTransfersV355Test-1442393337 None] Created volume successfully. Nov 10 04:22:44.577495 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adea4e8e-aa94-4e6f-831b-e5f0588c4220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4b9a83-6892-4773-a0e4-1afae25a0515', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.580625 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a41339-6d77-45d5-b815-ea0d57324978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:44.593234 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Volume volume-ed4b9a83-6892-4773-a0e4-1afae25a0515 (ed4b9a83-6892-4773-a0e4-1afae25a0515): created successfully Nov 10 04:22:44.596654 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a41339-6d77-45d5-b815-ea0d57324978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:44.599884 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Flow 'volume_create_manager' (1bbe8fd0-63ca-4135-a713-e50dbdc26d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:44.611922 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ca477a1a-ea3e-42da-871c-452c7ecd1c86 tempest-VolumesImageMetadata-1354787313 None] Created volume successfully. Nov 10 04:22:45.183071 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] Lock "b'cinder-ed4b9a83-6892-4773-a0e4-1afae25a0515-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:45.228932 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:45.358732 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:45.369386 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] deleting rbd volume volume-ed4b9a83-6892-4773-a0e4-1afae25a0515 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:45.541949 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6a3f86ad-cc9d-493b-8515-facf75cd14a4 tempest-VolumesTransfersV355Test-1112330324 None] Transfer volume completed successfully. Nov 10 04:22:45.713273 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:22:45.758223 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] deleting parent snapshot volume-ed4b9a83-6892-4773-a0e4-1afae25a0515.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:22:46.232868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] Lock "b'cinder-72bfaa9e-4523-4384-92b9-24e76bc0c197-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:46.280378 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:46.358510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:46.359003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] Volume volume-72bfaa9e-4523-4384-92b9-24e76bc0c197 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:46.365242 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] deleting rbd volume volume-72bfaa9e-4523-4384-92b9-24e76bc0c197 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:46.375036 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] Created reservations ['746b3e0a-9d68-40be-95e2-3ead77e252e5', '35b9b666-b88f-4877-abea-ab2b87c3e834', '2659a090-4188-4e50-8174-5922191a8661', '08ee10f2-381b-4c5f-91ab-9491421f17d1'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:46.428256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:46.469319 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:46.504653 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:46.509828 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] Deleted volume successfully. Nov 10 04:22:46.527003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-4caa5fe9-f102-41b0-92b8-bc1978c203e4 tempest-VolumesImageMetadata-1354787313 None] Lock "b'cinder-ed4b9a83-6892-4773-a0e4-1afae25a0515-delete_volume'" released by "delete_volume" :: held 1.342s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:46.663215 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] Created reservations ['4bdb78ba-3c9c-4f53-a1f1-3730f9a4e8d6', 'fcedd02c-c347-4b83-b095-ef6924ef816d', '15f9d589-0f97-4a1e-addb-edf307938dd7', '7811a5ce-1006-413e-a38c-a03d29a00da1'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:46.735284 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:46.793526 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:46.856538 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:46.860933 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] Deleted volume successfully. Nov 10 04:22:46.874939 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7eafbeb1-011f-4f61-9982-53c117fd37ea tempest-VolumesTransfersV355Test-338780475 None] Lock "b'cinder-72bfaa9e-4523-4384-92b9-24e76bc0c197-delete_volume'" released by "delete_volume" :: held 0.642s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:47.741402 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:47.746133 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:47.746646 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:47.771690 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Flow 'volume_create_manager' (4a1924d4-42c0-40fd-8ff2-e20f94e2f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:47.775389 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70496c80-6e46-4c84-a198-ced8a9bf5a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:47.783686 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:47.799321 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70496c80-6e46-4c84-a198-ced8a9bf5a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-247160741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b2fa6105-7af6-449c-9c66-f0236cd137d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24808a1e4ad448aa8b47953c2db99d20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:48Z,use_quota=True,user_id='db173b81e5f747afb7f443d570ae1ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:47.803448 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6d3d9d-074e-4cc6-8d20-60da69143ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:47.806287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6d3d9d-074e-4cc6-8d20-60da69143ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:47.808849 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ac62af-ff88-4e98-810c-79cd3f9b4be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:47.818251 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ac62af-ff88-4e98-810c-79cd3f9b4be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2fa6105-7af6-449c-9c66-f0236cd137d1', 'volume_name': 'volume-b2fa6105-7af6-449c-9c66-f0236cd137d1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:47.822774 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c282275b-6d09-4512-aedb-845ad2c0db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:47.826883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c282275b-6d09-4512-aedb-845ad2c0db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:47.832975 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826fbc92-258b-46ae-a976-aa455df0831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:47.833793 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Volume b2fa6105-7af6-449c-9c66-f0236cd137d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2fa6105-7af6-449c-9c66-f0236cd137d1', 'volume_size': 1} Nov 10 04:22:47.834187 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] creating volume 'volume-b2fa6105-7af6-449c-9c66-f0236cd137d1' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:47.838189 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:48.003446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:48.004095 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:48.006288 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826fbc92-258b-46ae-a976-aa455df0831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2fa6105-7af6-449c-9c66-f0236cd137d1', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:48.008630 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5fb299-5163-44b3-9656-4f13082b7f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:48.020182 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Volume volume-b2fa6105-7af6-449c-9c66-f0236cd137d1 (b2fa6105-7af6-449c-9c66-f0236cd137d1): created successfully Nov 10 04:22:48.022577 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5fb299-5163-44b3-9656-4f13082b7f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:48.026128 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Flow 'volume_create_manager' (4a1924d4-42c0-40fd-8ff2-e20f94e2f260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:48.037904 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-57bac790-671e-49e0-8076-0161bfc5a4e7 tempest-VolumesTransfersV355Test-1442393337 None] Created volume successfully. Nov 10 04:22:49.255776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] Lock "b'cinder-b2fa6105-7af6-449c-9c66-f0236cd137d1-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:22:49.315066 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:49.452492 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:22:49.452932 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] Volume volume-b2fa6105-7af6-449c-9c66-f0236cd137d1 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:22:49.475441 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] deleting rbd volume volume-b2fa6105-7af6-449c-9c66-f0236cd137d1 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:22:49.844902 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] Created reservations ['f3e51294-b89a-41e8-8428-b046bf9b699e', '3fad21bc-e829-41f9-b229-f1eea175af60', '36ac5e53-f252-47b9-bd37-e410305a9079', '451af6af-d171-4102-9279-82073c12c8dc'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:22:49.895748 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:49.952081 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:50.018866 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:22:50.027764 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] Deleted volume successfully. Nov 10 04:22:50.054122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-858608e1-2389-4825-8b8d-765efb731abe tempest-VolumesTransfersV355Test-338780475 None] Lock "b'cinder-b2fa6105-7af6-449c-9c66-f0236cd137d1-delete_volume'" released by "delete_volume" :: held 0.799s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:22:56.942618 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:22:56.954672 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:22:56.955397 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:22:56.982700 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Flow 'volume_create_manager' (8ef5544c-e8d4-4086-a877-99f862fa99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:56.986199 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016cb7cb-9aed-479b-8c5c-0cb0fb369e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:57.003899 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:22:57.020089 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016cb7cb-9aed-479b-8c5c-0cb0fb369e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1318458525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=e2f104b1-3179-4960-b1ac-10e3767ce5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62a6f0117a4f2194c44a9e41d6c3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:22:57Z,use_quota=True,user_id='b0f8ed76dcab4875890d7325914b22ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:57.024172 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf531a-4e54-4c08-9e96-91e93866747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:57.027543 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf531a-4e54-4c08-9e96-91e93866747a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:57.031381 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bf6a76-5c95-4684-b2dc-0719360cc291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:57.034190 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bf6a76-5c95-4684-b2dc-0719360cc291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'volume_name': 'volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:57.037522 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b695c22-b0c7-4e58-93f2-6ab33d6d2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:57.040056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b695c22-b0c7-4e58-93f2-6ab33d6d2d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:57.042571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e37696a-25ee-497c-b5d0-d3b0e55b4fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:57.043715 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Volume e2f104b1-3179-4960-b1ac-10e3767ce5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'volume_size': 1} Nov 10 04:22:57.044301 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] creating volume 'volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:22:57.045564 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:22:57.182406 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:22:57.182948 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:22:57.186116 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e37696a-25ee-497c-b5d0-d3b0e55b4fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:57.192317 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad4526b-9768-46df-82d7-2eba0826c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:22:57.207641 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Volume volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad (e2f104b1-3179-4960-b1ac-10e3767ce5ad): created successfully Nov 10 04:22:57.212007 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad4526b-9768-46df-82d7-2eba0826c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:22:57.222994 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Flow 'volume_create_manager' (8ef5544c-e8d4-4086-a877-99f862fa99a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:22:57.235305 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cada7c30-b217-4d2d-b2a4-49b17a1a15b6 tempest-VolumesBackupsTest-1397900487 None] Created volume successfully. Nov 10 04:23:08.197045 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:23:08.201557 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:23:08.202017 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:23:08.215845 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (deb5ff2e-872b-4333-b7a6-5d078ea3f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:08.219942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ca2246-db88-4bb8-8616-8ecc770706dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:08.227250 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:23:08.240868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ca2246-db88-4bb8-8616-8ecc770706dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2115465275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=29133cfe-a85b-4178-9e70-0bba46cd2e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be6c4098d8d4e41954d19a88075cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:23:08Z,use_quota=True,user_id='0ab02363def54c2baaf0c83f5377e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:08.243594 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd375f-bfa9-4f98-a155-df0c4a46c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:08.246131 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd375f-bfa9-4f98-a155-df0c4a46c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:08.248925 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b717d40f-1c86-416c-9ec8-4f4c365c8470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:08.353769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b717d40f-1c86-416c-9ec8-4f4c365c8470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29133cfe-a85b-4178-9e70-0bba46cd2e23', 'volume_name': 'volume-29133cfe-a85b-4178-9e70-0bba46cd2e23', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:08.356933 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a56277-1748-4834-b83f-69c6051214ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:08.360409 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a56277-1748-4834-b83f-69c6051214ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:08.363900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ccd24-ebd2-41f8-8445-5a196fa7ec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:08.365158 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Volume 29133cfe-a85b-4178-9e70-0bba46cd2e23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29133cfe-a85b-4178-9e70-0bba46cd2e23', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:23:08.366052 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Cloning 29133cfe-a85b-4178-9e70-0bba46cd2e23 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:23:08.376342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:08.388547 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 23, 8, 380594)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:23:08.389103 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:23:08.389580 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:23:08.394605 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:08.396818 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:23:08.401673 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 23, 8, 399179)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:23:08.402397 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:23:08.402732 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:23:08.416132 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:08.492225 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] creating snapshot='volume-29133cfe-a85b-4178-9e70-0bba46cd2e23.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:23:08.760568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-29133cfe-a85b-4178-9e70-0bba46cd2e23.clone_snap' to 'volume-29133cfe-a85b-4178-9e70-0bba46cd2e23' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:23:08.971053 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:23:08.973296 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:23:08.973671 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:23:09.011853 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:23:09.014216 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Marking volume 29133cfe-a85b-4178-9e70-0bba46cd2e23 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:23:09.029326 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 29133cfe-a85b-4178-9e70-0bba46cd2e23. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:23:09.029746 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Creating volume glance metadata for volume 29133cfe-a85b-4178-9e70-0bba46cd2e23 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:23:09.106717 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ccd24-ebd2-41f8-8445-5a196fa7ec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29133cfe-a85b-4178-9e70-0bba46cd2e23', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:09.109762 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0768ca-bb08-4a90-a73e-ef7db80fe011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:09.118930 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Volume volume-29133cfe-a85b-4178-9e70-0bba46cd2e23 (29133cfe-a85b-4178-9e70-0bba46cd2e23): created successfully Nov 10 04:23:09.124220 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0768ca-bb08-4a90-a73e-ef7db80fe011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:09.128766 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (deb5ff2e-872b-4333-b7a6-5d078ea3f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:09.145344 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-bb34de46-5d83-4b38-bb15-597acce9a59a tempest-TestVolumeBootPattern-1790488751 None] Created volume successfully. Nov 10 04:23:09.553478 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a7936a5-6374-4f7b-aa64-5df0ca13c987 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:10.003394 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a7936a5-6374-4f7b-aa64-5df0ca13c987 tempest-TestVolumeBootPattern-1790488751 None] Create snapshot completed successfully Nov 10 04:23:14.303788 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:23:14.313052 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:23:14.313655 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:23:14.358098 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (0a2228e2-8b12-4c09-b8db-b25f0827ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:14.365271 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7752897-10a3-40ad-aea8-a12e820aaf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:14.388300 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:23:14.422146 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7752897-10a3-40ad-aea8-a12e820aaf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:23:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=dfd0b968-8bb0-494e-a94c-c3e24e3913ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be6c4098d8d4e41954d19a88075cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eff7f7c9-6039-4e4b-83d7-529ae69bbccc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:23:14Z,use_quota=True,user_id='0ab02363def54c2baaf0c83f5377e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:14.437374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dec90ed-4904-4c77-bfed-6ab6a445f1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:14.440282 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dec90ed-4904-4c77-bfed-6ab6a445f1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:14.445403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0360bf8d-124d-42da-9895-e66200eb4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:14.455242 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0360bf8d-124d-42da-9895-e66200eb4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'volume_name': 'volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'volume_size': 1, 'snapshot_id': 'eff7f7c9-6039-4e4b-83d7-529ae69bbccc'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:14.458454 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61b0d47-14cf-44ac-a81e-ce78cf02bf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:14.463883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61b0d47-14cf-44ac-a81e-ce78cf02bf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:14.472112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afab8ad-8318-439b-8535-cb93b9ba0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:14.473283 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Volume dfd0b968-8bb0-494e-a94c-c3e24e3913ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'volume_size': 1, 'snapshot_id': 'eff7f7c9-6039-4e4b-83d7-529ae69bbccc'} Nov 10 04:23:14.541681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] cloning volumes/volume-29133cfe-a85b-4178-9e70-0bba46cd2e23@snapshot-eff7f7c9-6039-4e4b-83d7-529ae69bbccc to volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:23:14.544510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:14.665903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:14.983219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:23:14.983985 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:23:15.016761 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Marking volume dfd0b968-8bb0-494e-a94c-c3e24e3913ac as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:23:15.034054 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Copying metadata from snapshot eff7f7c9-6039-4e4b-83d7-529ae69bbccc to dfd0b968-8bb0-494e-a94c-c3e24e3913ac. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 10 04:23:15.095696 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afab8ad-8318-439b-8535-cb93b9ba0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'volume_size': 1, 'snapshot_id': 'eff7f7c9-6039-4e4b-83d7-529ae69bbccc'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:15.099858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4905c122-df38-4b38-a7af-0be4a7f1fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:15.114926 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Volume volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac (dfd0b968-8bb0-494e-a94c-c3e24e3913ac): created successfully Nov 10 04:23:15.146634 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4905c122-df38-4b38-a7af-0be4a7f1fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:15.171342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (0a2228e2-8b12-4c09-b8db-b25f0827ac08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:15.214760 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-7661fbfa-12f5-42ce-90e9-40c7c2c297be tempest-TestVolumeBootPattern-1790488751 None] Created volume successfully. Nov 10 04:23:17.622452 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-b1c69038-5469-4288-9ca0-5373946a7f83 tempest-TestVolumeBootPattern-1790488751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:23:18.319137 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-da0be2b7-a125-44af-bb8a-32d1e203c7b0 req-18233456-60f0-4264-b210-a72158757375 tempest-VolumesBackupsTest-1397900487 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:23:18.443322 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-b1c69038-5469-4288-9ca0-5373946a7f83 tempest-TestVolumeBootPattern-1790488751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.820s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:23:18.444586 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-b1c69038-5469-4288-9ca0-5373946a7f83 tempest-TestVolumeBootPattern-1790488751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:23:18.474573 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-b1c69038-5469-4288-9ca0-5373946a7f83 tempest-TestVolumeBootPattern-1790488751 None] Connection info returned from driver {'name': 'volumes/volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dfd0b968-8bb0-494e-a94c-c3e24e3913ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4979b4ee-240d-400e-a751-d17593a15df8'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:23:18.577723 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-cccfbe47-22ab-4615-99b8-3582bd5f32e3 req-b1c69038-5469-4288-9ca0-5373946a7f83 tempest-TestVolumeBootPattern-1790488751 None] attachment_update completed successfully. Nov 10 04:23:19.176929 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-da0be2b7-a125-44af-bb8a-32d1e203c7b0 req-18233456-60f0-4264-b210-a72158757375 tempest-VolumesBackupsTest-1397900487 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.858s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:23:19.178347 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-da0be2b7-a125-44af-bb8a-32d1e203c7b0 req-18233456-60f0-4264-b210-a72158757375 tempest-VolumesBackupsTest-1397900487 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:23:19.199952 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-da0be2b7-a125-44af-bb8a-32d1e203c7b0 req-18233456-60f0-4264-b210-a72158757375 tempest-VolumesBackupsTest-1397900487 None] Connection info returned from driver {'name': 'volumes/volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '556c83b9-dec6-4b60-8e0a-f5a537f9cfde'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:23:19.253443 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-da0be2b7-a125-44af-bb8a-32d1e203c7b0 req-18233456-60f0-4264-b210-a72158757375 tempest-VolumesBackupsTest-1397900487 None] attachment_update completed successfully. Nov 10 04:23:21.728446 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-fc5ef97d-e65c-4d1a-8420-01cd896044ee tempest-VolumesBackupsTest-1397900487 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:23:22.578903 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-fc5ef97d-e65c-4d1a-8420-01cd896044ee tempest-VolumesBackupsTest-1397900487 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:23:22.580354 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-fc5ef97d-e65c-4d1a-8420-01cd896044ee tempest-VolumesBackupsTest-1397900487 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'e2f104b1-3179-4960-b1ac-10e3767ce5ad', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:23:22.603413 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fc5ef97d-e65c-4d1a-8420-01cd896044ee tempest-VolumesBackupsTest-1397900487 None] Initialize volume connection completed successfully. Nov 10 04:23:25.019992 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fc5ef97d-e65c-4d1a-8420-01cd896044ee tempest-VolumesBackupsTest-1397900487 None] Terminate volume connection completed successfully. Nov 10 04:23:25.051981 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-fc5ef97d-e65c-4d1a-8420-01cd896044ee tempest-VolumesBackupsTest-1397900487 None] Remove volume export completed successfully. Nov 10 04:23:28.557859 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:23:28.558885 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:28.612246 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:28.661895 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:23:28.923392 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-0ae027b4-6e7e-4ab4-a00f-253f8e971ff1 req-3e108b73-9ed9-4df0-ab5a-9430aeb56366 tempest-VolumesBackupsTest-1397900487 None] Terminate volume connection completed successfully. Nov 10 04:23:28.923392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-0ae027b4-6e7e-4ab4-a00f-253f8e971ff1 req-3e108b73-9ed9-4df0-ab5a-9430aeb56366 tempest-VolumesBackupsTest-1397900487 None] Deleting attachment 556c83b9-dec6-4b60-8e0a-f5a537f9cfde. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:23:30.609652 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-adc57d1e-1158-4bd3-b36e-ac45d0326611 tempest-TestVolumeBootPattern-1790488751 None] Terminate volume connection completed successfully. Nov 10 04:23:30.610926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-adc57d1e-1158-4bd3-b36e-ac45d0326611 tempest-TestVolumeBootPattern-1790488751 None] Deleting attachment 4979b4ee-240d-400e-a751-d17593a15df8. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:23:30.773914 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-dfd0b968-8bb0-494e-a94c-c3e24e3913ac-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:30.826858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:30.938663 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:23:30.956383 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] deleting rbd volume volume-dfd0b968-8bb0-494e-a94c-c3e24e3913ac {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:23:31.376156 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['b26b0ecb-6d14-4387-b33c-191570e793d8', 'f24a0195-3830-4a81-aea8-37cf9713d979', 'a0dfe4c1-c6e7-4fab-b92f-aaef6184af96', '72e5011f-dd70-402e-9a67-c3201088af25'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:23:31.451427 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:31.492917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:31.538654 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:23:31.546848 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] Deleted volume successfully. Nov 10 04:23:31.565452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-1699cb87-5f9b-447e-a60b-f287cae38bfe req-73739497-3bcb-443f-9079-10b48b9327b2 tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-dfd0b968-8bb0-494e-a94c-c3e24e3913ac-delete_volume'" released by "delete_volume" :: held 0.791s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:32.694085 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-882eb8f2-fc49-43e9-ae45-c51ca3be41df tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-eff7f7c9-6039-4e4b-83d7-529ae69bbccc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:32.698353 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-882eb8f2-fc49-43e9-ae45-c51ca3be41df tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:33.497488 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-e2f104b1-3179-4960-b1ac-10e3767ce5ad-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:33.565291 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:33.935814 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] Volume volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:23:33.978917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] deleting rbd volume volume-e2f104b1-3179-4960-b1ac-10e3767ce5ad {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:23:34.115978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-882eb8f2-fc49-43e9-ae45-c51ca3be41df tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['7f1f0a96-9f10-40b9-b519-33ff46ac1847', 'd113f219-ffc5-4806-aabc-c44e390759bf', '2d98bd45-7037-4db9-a697-6ac17a473f8a', 'efcdc50e-98ab-46ea-af12-76b1b2b0d441'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:23:34.220074 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-882eb8f2-fc49-43e9-ae45-c51ca3be41df tempest-TestVolumeBootPattern-1790488751 None] Delete snapshot completed successfully. Nov 10 04:23:34.226099 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-882eb8f2-fc49-43e9-ae45-c51ca3be41df tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-eff7f7c9-6039-4e4b-83d7-529ae69bbccc-delete_snapshot'" released by "delete_snapshot" :: held 1.532s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:34.411275 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] Created reservations ['98365971-d8bb-4460-89c7-db8e9e7ed437', '4d4fce88-e811-4f37-a793-8ffb774b1007', 'f9c2bcfb-abe8-4e97-b0f2-7a1c45e25836', '3a5f9c58-e290-4d3e-a56e-044a9eae3c4e'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:23:34.465817 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:34.560179 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:34.640022 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:23:34.657010 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] Deleted volume successfully. Nov 10 04:23:34.676480 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-cbd7ff91-b7a7-44f6-8f84-be904a6303c1 tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-e2f104b1-3179-4960-b1ac-10e3767ce5ad-delete_volume'" released by "delete_volume" :: held 1.179s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:34.887473 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-29133cfe-a85b-4178-9e70-0bba46cd2e23-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:34.968942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:35.080307 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:23:35.091186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] deleting rbd volume volume-29133cfe-a85b-4178-9e70-0bba46cd2e23 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:23:35.248105 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:23:35.251878 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:23:35.252373 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:23:35.265480 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Flow 'volume_create_manager' (25402576-a6ae-4c4b-8fbc-162b59ca2963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:35.269163 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d738cd-af07-4152-bc5f-be20d3463f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:35.275526 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:23:35.290634 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d738cd-af07-4152-bc5f-be20d3463f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-210735638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=6c30d2ca-7042-44c8-b348-092a2c517edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62a6f0117a4f2194c44a9e41d6c3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:23:35Z,use_quota=True,user_id='b0f8ed76dcab4875890d7325914b22ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:35.293603 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda046a-6f58-4a36-abfd-cad89ed7ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:35.296991 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda046a-6f58-4a36-abfd-cad89ed7ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:35.300175 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad0d62a-d6ab-4098-ada7-8f8d95c7a9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:35.354921 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:23:35.389770 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] deleting parent snapshot volume-29133cfe-a85b-4178-9e70-0bba46cd2e23.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:23:36.066194 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad0d62a-d6ab-4098-ada7-8f8d95c7a9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c30d2ca-7042-44c8-b348-092a2c517edb', 'volume_name': 'volume-6c30d2ca-7042-44c8-b348-092a2c517edb', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:36.068568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e0ce0d-2576-4f31-a748-df792c606730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:36.070827 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e0ce0d-2576-4f31-a748-df792c606730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:36.072983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dad801-519c-41c5-82a6-c626e114adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:36.074468 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Volume 6c30d2ca-7042-44c8-b348-092a2c517edb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c30d2ca-7042-44c8-b348-092a2c517edb', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:23:36.075269 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Cloning 6c30d2ca-7042-44c8-b348-092a2c517edb from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:23:36.091155 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:36.101945 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['5c365cb3-008d-408a-8d77-792f9a8cff0d', '5d1fbb8f-7dc4-43aa-807f-5d450f10bd40', '28ec0380-601a-4b86-8264-326e84756b6c', '3bc1efe9-d566-4ece-b792-dbcd9f3b9ddd'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:23:36.106771 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 23, 36, 99679)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:23:36.107437 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:23:36.108093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:23:36.115964 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:36.116920 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:23:36.127906 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 23, 36, 123313)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:23:36.129958 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:23:36.130383 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:23:36.146516 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:36.211442 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] creating snapshot='volume-6c30d2ca-7042-44c8-b348-092a2c517edb.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:23:36.997902 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-6c30d2ca-7042-44c8-b348-092a2c517edb.clone_snap' to 'volume-6c30d2ca-7042-44c8-b348-092a2c517edb' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:23:37.061857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:37.159356 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:37.212113 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:23:37.267420 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:23:37.269945 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:23:37.270569 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:23:37.306055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:23:37.307173 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Marking volume 6c30d2ca-7042-44c8-b348-092a2c517edb as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:23:37.314404 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] Deleted volume successfully. Nov 10 04:23:37.323494 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 6c30d2ca-7042-44c8-b348-092a2c517edb. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:23:37.323903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Creating volume glance metadata for volume 6c30d2ca-7042-44c8-b348-092a2c517edb backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:23:37.352169 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-87380c71-ed64-4b42-b047-193a2c8cd35c tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-29133cfe-a85b-4178-9e70-0bba46cd2e23-delete_volume'" released by "delete_volume" :: held 2.465s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:37.418240 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dad801-519c-41c5-82a6-c626e114adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c30d2ca-7042-44c8-b348-092a2c517edb', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:37.421655 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14aad82-28b3-42e4-a07d-7a53702db802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:37.438757 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Volume volume-6c30d2ca-7042-44c8-b348-092a2c517edb (6c30d2ca-7042-44c8-b348-092a2c517edb): created successfully Nov 10 04:23:37.441093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14aad82-28b3-42e4-a07d-7a53702db802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:37.444359 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Flow 'volume_create_manager' (25402576-a6ae-4c4b-8fbc-162b59ca2963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:37.455004 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2090da98-87fd-4d6f-a306-a0900ba89628 tempest-VolumesBackupsTest-1397900487 None] Created volume successfully. Nov 10 04:23:37.683407 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:23:37.690174 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:23:37.690880 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:23:37.706566 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (cbed0719-2549-4db8-8129-e0dc92c38872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:37.711871 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde14e9b-2c24-48db-8fec-c8574c8d1fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:37.719999 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:23:37.734369 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde14e9b-2c24-48db-8fec-c8574c8d1fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-672955840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=8afe0bbd-39ee-4262-a035-187190eab4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be6c4098d8d4e41954d19a88075cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:23:38Z,use_quota=True,user_id='0ab02363def54c2baaf0c83f5377e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:37.737658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecbe4f3-3104-4bc0-b990-1deda1eed910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:37.740247 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecbe4f3-3104-4bc0-b990-1deda1eed910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:37.742943 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885f02b9-6228-4d93-97c2-38c7b1b16b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:37.859985 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885f02b9-6228-4d93-97c2-38c7b1b16b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8afe0bbd-39ee-4262-a035-187190eab4c0', 'volume_name': 'volume-8afe0bbd-39ee-4262-a035-187190eab4c0', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:37.862607 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f60e790-a83b-4f1f-94f7-996e8df61b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:37.865048 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f60e790-a83b-4f1f-94f7-996e8df61b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:37.867516 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee95719-335e-47b0-bfe5-69351c9cc61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:37.868345 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Volume 8afe0bbd-39ee-4262-a035-187190eab4c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8afe0bbd-39ee-4262-a035-187190eab4c0', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:23:37.868945 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Cloning 8afe0bbd-39ee-4262-a035-187190eab4c0 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:23:37.894301 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:37.911449 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 23, 37, 904885)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:23:37.911868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:23:37.912275 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:23:37.918485 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:23:37.919547 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:23:37.925980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 23, 37, 922891)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:23:37.926412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:23:37.927035 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:23:37.940544 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:38.024273 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] creating snapshot='volume-8afe0bbd-39ee-4262-a035-187190eab4c0.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:23:39.041250 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-8afe0bbd-39ee-4262-a035-187190eab4c0.clone_snap' to 'volume-8afe0bbd-39ee-4262-a035-187190eab4c0' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:23:39.114685 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-98be2b57-32e9-453b-82ea-f3e1d1098768 tempest-VolumesBackupsTest-1397900487 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:23:39.267061 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:23:39.273922 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:23:39.274317 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:23:39.312917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:23:39.313771 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Marking volume 8afe0bbd-39ee-4262-a035-187190eab4c0 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:23:39.329186 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 8afe0bbd-39ee-4262-a035-187190eab4c0. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:23:39.329727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Creating volume glance metadata for volume 8afe0bbd-39ee-4262-a035-187190eab4c0 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:23:39.441962 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee95719-335e-47b0-bfe5-69351c9cc61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afe0bbd-39ee-4262-a035-187190eab4c0', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:39.448182 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98353282-cec4-46a5-a3ee-a71d10947740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:39.465766 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Volume volume-8afe0bbd-39ee-4262-a035-187190eab4c0 (8afe0bbd-39ee-4262-a035-187190eab4c0): created successfully Nov 10 04:23:39.467721 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98353282-cec4-46a5-a3ee-a71d10947740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:39.470980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (cbed0719-2549-4db8-8129-e0dc92c38872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:39.484588 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-49320b8f-963e-4557-a9c7-b8dfcacd42da tempest-TestVolumeBootPattern-1790488751 None] Created volume successfully. Nov 10 04:23:40.145397 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-98be2b57-32e9-453b-82ea-f3e1d1098768 tempest-VolumesBackupsTest-1397900487 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.031s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:23:40.146917 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-98be2b57-32e9-453b-82ea-f3e1d1098768 tempest-VolumesBackupsTest-1397900487 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c30d2ca-7042-44c8-b348-092a2c517edb', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '6c30d2ca-7042-44c8-b348-092a2c517edb', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:23:40.169674 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-98be2b57-32e9-453b-82ea-f3e1d1098768 tempest-VolumesBackupsTest-1397900487 None] Initialize volume connection completed successfully. Nov 10 04:23:44.628914 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a52f7bd6-6e8f-481b-b7dc-8217caf760cb req-458a314e-1a77-4986-9ad3-95e5af451b6c tempest-TestVolumeBootPattern-1790488751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:23:45.747338 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a52f7bd6-6e8f-481b-b7dc-8217caf760cb req-458a314e-1a77-4986-9ad3-95e5af451b6c tempest-TestVolumeBootPattern-1790488751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.117s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:23:45.748413 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a52f7bd6-6e8f-481b-b7dc-8217caf760cb req-458a314e-1a77-4986-9ad3-95e5af451b6c tempest-TestVolumeBootPattern-1790488751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8afe0bbd-39ee-4262-a035-187190eab4c0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '8afe0bbd-39ee-4262-a035-187190eab4c0', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:23:45.827003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a52f7bd6-6e8f-481b-b7dc-8217caf760cb req-458a314e-1a77-4986-9ad3-95e5af451b6c tempest-TestVolumeBootPattern-1790488751 None] Connection info returned from driver {'name': 'volumes/volume-8afe0bbd-39ee-4262-a035-187190eab4c0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8afe0bbd-39ee-4262-a035-187190eab4c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '93037deb-2aaa-4da7-ba80-f7f60cb72dda'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:23:45.936309 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a52f7bd6-6e8f-481b-b7dc-8217caf760cb req-458a314e-1a77-4986-9ad3-95e5af451b6c tempest-TestVolumeBootPattern-1790488751 None] attachment_update completed successfully. Nov 10 04:23:47.062187 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-98be2b57-32e9-453b-82ea-f3e1d1098768 tempest-VolumesBackupsTest-1397900487 None] Terminate volume connection completed successfully. Nov 10 04:23:47.086506 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-98be2b57-32e9-453b-82ea-f3e1d1098768 tempest-VolumesBackupsTest-1397900487 None] Remove volume export completed successfully. Nov 10 04:23:48.880224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:23:48.884771 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:23:48.885497 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:23:48.907064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Flow 'volume_create_manager' (6e2c70a5-767c-42b9-b324-6ddfaabacdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:48.910735 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f520d1d9-a03b-4603-ae72-4881e5de5553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:48.919741 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:23:48.933797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f520d1d9-a03b-4603-ae72-4881e5de5553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:23:48Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_2dfae63e-fb1b-4968-9870-e7af4b7fa2e7',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=4515a9a8-0c73-4773-a967-98fdff017ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d62a6f0117a4f2194c44a9e41d6c3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:23:49Z,use_quota=True,user_id='b0f8ed76dcab4875890d7325914b22ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:48.936316 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f07b02-889f-455d-addd-e4b72630b05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:48.939416 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f07b02-889f-455d-addd-e4b72630b05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:48.942811 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34046379-e466-48f5-9d04-8af4b72bdf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:48.945336 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34046379-e466-48f5-9d04-8af4b72bdf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4515a9a8-0c73-4773-a967-98fdff017ce5', 'volume_name': 'volume-4515a9a8-0c73-4773-a967-98fdff017ce5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:48.947870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a58d67-21b7-4e6f-bd2d-1fa46344a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:48.951026 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a58d67-21b7-4e6f-bd2d-1fa46344a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:48.953831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e8e82b-cd9a-4bed-b455-973c0b0ce5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:48.954806 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Volume 4515a9a8-0c73-4773-a967-98fdff017ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4515a9a8-0c73-4773-a967-98fdff017ce5', 'volume_size': 1} Nov 10 04:23:48.955414 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] creating volume 'volume-4515a9a8-0c73-4773-a967-98fdff017ce5' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:23:48.956943 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:49.087936 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:23:49.089567 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:23:49.091749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e8e82b-cd9a-4bed-b455-973c0b0ce5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4515a9a8-0c73-4773-a967-98fdff017ce5', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:49.094133 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e73c1-61cf-4413-8b37-4306d551924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:23:49.109163 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Volume volume-4515a9a8-0c73-4773-a967-98fdff017ce5 (4515a9a8-0c73-4773-a967-98fdff017ce5): created successfully Nov 10 04:23:49.111891 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e73c1-61cf-4413-8b37-4306d551924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:23:49.115766 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Flow 'volume_create_manager' (6e2c70a5-767c-42b9-b324-6ddfaabacdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:23:49.127595 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Created volume successfully. Nov 10 04:23:50.052049 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:23:51.083685 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.031s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:23:51.085704 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4515a9a8-0c73-4773-a967-98fdff017ce5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '4515a9a8-0c73-4773-a967-98fdff017ce5', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:23:51.106228 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Initialize volume connection completed successfully. Nov 10 04:23:57.462420 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Terminate volume connection completed successfully. Nov 10 04:23:57.488856 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-d77707d8-9a6d-4165-84c0-56c0861ad452 tempest-VolumesBackupsTest-1397900487 None] Remove volume export completed successfully. Nov 10 04:23:58.427505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-4515a9a8-0c73-4773-a967-98fdff017ce5-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:23:58.470841 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:23:59.032815 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] Volume volume-4515a9a8-0c73-4773-a967-98fdff017ce5 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:23:59.069971 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] deleting rbd volume volume-4515a9a8-0c73-4773-a967-98fdff017ce5 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:23:59.978458 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] Created reservations ['e76a413d-46f1-4c32-8d80-5a1784ca57b2', '4ebfdf52-a05b-42d4-a7fd-e354a729c8b6', '7a529933-4123-4a1c-b6c6-3c051efb5d82', 'e34e09e8-1810-47bf-985c-e1dd17fdcb2d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:24:00.044963 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:00.105416 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:00.193604 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:24:00.199664 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] Deleted volume successfully. Nov 10 04:24:00.216954 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e0f72ec9-f8a1-400a-9d59-bdb3cfc33ecf tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-4515a9a8-0c73-4773-a967-98fdff017ce5-delete_volume'" released by "delete_volume" :: held 1.789s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:24:01.311499 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-21f4df7a-c27b-4a17-a3c8-924be47964de req-45812ef4-2ac8-424f-b76b-a60e24429301 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:02.490191 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-21f4df7a-c27b-4a17-a3c8-924be47964de req-45812ef4-2ac8-424f-b76b-a60e24429301 tempest-TestVolumeBootPattern-1790488751 None] Create snapshot completed successfully Nov 10 04:24:02.966006 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-6c30d2ca-7042-44c8-b348-092a2c517edb-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:24:03.013787 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:03.382648 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] deleting rbd volume volume-6c30d2ca-7042-44c8-b348-092a2c517edb {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:24:03.742272 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:24:03.795509 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] deleting parent snapshot volume-6c30d2ca-7042-44c8-b348-092a2c517edb.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:24:04.515968 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] Created reservations ['ea75e108-3c80-433f-988b-497f7b29e6dd', 'd2f580e7-629b-457d-ba29-46dc8e2f55a8', '2a90107a-6e2a-40af-b3a0-3fae0e5292e7', '82f94552-a199-4e77-9d5b-f490ca957368'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:24:04.588323 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:04.650842 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:04.696681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:24:04.701245 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] Deleted volume successfully. Nov 10 04:24:04.719876 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-e381737f-a23c-438e-b9fe-22c43352e7df tempest-VolumesBackupsTest-1397900487 None] Lock "b'cinder-6c30d2ca-7042-44c8-b348-092a2c517edb-delete_volume'" released by "delete_volume" :: held 1.754s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:24:05.976339 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:24:05.981264 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:24:05.981963 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:24:06.008897 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (bfe4023d-4e01-4ed6-b83f-89aed07ef83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:24:06.013783 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8c5db7-2c35-4eca-aeca-097eb75818a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:06.024362 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:24:06.040471 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8c5db7-2c35-4eca-aeca-097eb75818a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:24:06Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b3fb6409-41ae-42f0-878b-4d6d6fd0909f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be6c4098d8d4e41954d19a88075cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4a5a651-a487-40b1-b5fd-dd43729374f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:24:06Z,use_quota=True,user_id='0ab02363def54c2baaf0c83f5377e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:06.044094 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a9b6d-e8d4-4f28-912f-26faec3bb9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:06.046447 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a9b6d-e8d4-4f28-912f-26faec3bb9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:06.049151 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe44c56-908a-4878-b788-39c35abd3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:06.051839 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe44c56-908a-4878-b788-39c35abd3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'volume_name': 'volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'volume_size': 1, 'snapshot_id': 'c4a5a651-a487-40b1-b5fd-dd43729374f1'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:06.054365 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6e0388-3b51-4c5e-8b12-18ed8e22a825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:06.056762 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6e0388-3b51-4c5e-8b12-18ed8e22a825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:06.059785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914406fe-af6e-4943-9aca-a483d5e28ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:06.061045 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Volume b3fb6409-41ae-42f0-878b-4d6d6fd0909f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'volume_size': 1, 'snapshot_id': 'c4a5a651-a487-40b1-b5fd-dd43729374f1'} Nov 10 04:24:06.084281 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] cloning volumes/volume-8afe0bbd-39ee-4262-a035-187190eab4c0@snapshot-c4a5a651-a487-40b1-b5fd-dd43729374f1 to volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:24:06.085530 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:06.191014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:06.435829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:24:06.435829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:24:06.466590 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Marking volume b3fb6409-41ae-42f0-878b-4d6d6fd0909f as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:24:06.475754 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Copying metadata from snapshot c4a5a651-a487-40b1-b5fd-dd43729374f1 to b3fb6409-41ae-42f0-878b-4d6d6fd0909f. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 10 04:24:06.589170 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914406fe-af6e-4943-9aca-a483d5e28ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'volume_size': 1, 'snapshot_id': 'c4a5a651-a487-40b1-b5fd-dd43729374f1'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:06.600505 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1656497-5148-44eb-ba2d-d7ae2beb02de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:06.622254 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Volume volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f (b3fb6409-41ae-42f0-878b-4d6d6fd0909f): created successfully Nov 10 04:24:06.625758 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1656497-5148-44eb-ba2d-d7ae2beb02de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:06.630934 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (bfe4023d-4e01-4ed6-b83f-89aed07ef83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:24:06.665285 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-1a5ed27a-0613-41a9-b68d-23a8480cb8cd tempest-TestVolumeBootPattern-1790488751 None] Created volume successfully. Nov 10 04:24:08.904721 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:24:08.918756 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:24:08.919234 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:24:08.962678 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Flow 'volume_create_manager' (50e20673-1a8a-416e-b07e-37d2cf7e4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:24:08.970565 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c94504f-6bd4-4470-92a8-c9b6f1503072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:08.983489 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:24:09.010681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c94504f-6bd4-4470-92a8-c9b6f1503072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-430997269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=bc3c4203-7d1b-4653-8736-066d076dc6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec396383baa48d6ba4de8277a76dc3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:24:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:24:09Z,use_quota=True,user_id='24ce760664c24c1491bf04e612c2fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:09.022344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498960cd-bf49-4696-ba1f-7cd94213aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:09.025421 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498960cd-bf49-4696-ba1f-7cd94213aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:09.028248 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d841f-c180-40c4-aadf-ec60a0dd0f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:09.030789 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d841f-c180-40c4-aadf-ec60a0dd0f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3c4203-7d1b-4653-8736-066d076dc6b9', 'volume_name': 'volume-bc3c4203-7d1b-4653-8736-066d076dc6b9', 'volume_size': 2}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:09.034043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6f670d-6046-4440-8648-440b661a6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:09.036740 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6f670d-6046-4440-8648-440b661a6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:09.039219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399c0e03-bfc1-4e16-a89f-22175b1ded4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:09.040457 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Volume bc3c4203-7d1b-4653-8736-066d076dc6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3c4203-7d1b-4653-8736-066d076dc6b9', 'volume_size': 2} Nov 10 04:24:09.042203 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] creating volume 'volume-bc3c4203-7d1b-4653-8736-066d076dc6b9' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:24:09.043428 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:09.192241 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:24:09.192628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:24:09.199291 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399c0e03-bfc1-4e16-a89f-22175b1ded4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3c4203-7d1b-4653-8736-066d076dc6b9', 'volume_size': 2}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:09.202263 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdd0c79-f761-47c7-a19d-42a30fd20065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:24:09.218977 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Volume volume-bc3c4203-7d1b-4653-8736-066d076dc6b9 (bc3c4203-7d1b-4653-8736-066d076dc6b9): created successfully Nov 10 04:24:09.220951 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdd0c79-f761-47c7-a19d-42a30fd20065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:24:09.224245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Flow 'volume_create_manager' (50e20673-1a8a-416e-b07e-37d2cf7e4384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:24:09.271846 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f100ec43-01a4-4ce7-9c0a-7595eab8d34e tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Created volume successfully. Nov 10 04:24:09.405459 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-83f88a1a-9523-478a-8461-b923e30168cd tempest-TestVolumeBootPattern-1790488751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:24:10.312109 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a6afcde3-8422-40c0-83e0-512f2b07473d tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:10.926657 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-83f88a1a-9523-478a-8461-b923e30168cd tempest-TestVolumeBootPattern-1790488751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.521s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:24:10.927271 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-83f88a1a-9523-478a-8461-b923e30168cd tempest-TestVolumeBootPattern-1790488751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:24:10.941546 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a6afcde3-8422-40c0-83e0-512f2b07473d tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Create snapshot completed successfully Nov 10 04:24:10.980942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-83f88a1a-9523-478a-8461-b923e30168cd tempest-TestVolumeBootPattern-1790488751 None] Connection info returned from driver {'name': 'volumes/volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b3fb6409-41ae-42f0-878b-4d6d6fd0909f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0046bc79-125c-4495-b19e-e9e6a8127ad8'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:24:11.081899 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a754ec67-20c2-4c28-9c67-1ffa1f0d2504 req-83f88a1a-9523-478a-8461-b923e30168cd tempest-TestVolumeBootPattern-1790488751 None] attachment_update completed successfully. Nov 10 04:24:11.531273 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-972ecfd1-1436-4c02-875e-03bfb6b62365 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Lock "b'cinder-d926e095-852f-42dd-a62b-ae603a2a81dd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:24:11.533713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-972ecfd1-1436-4c02-875e-03bfb6b62365 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:12.407196 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-972ecfd1-1436-4c02-875e-03bfb6b62365 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Created reservations ['9d907bef-3660-4757-993a-3ac99c5c12cf', '5af60674-e1d1-4046-9fd1-d49043b75bd6', 'a943b2ba-69e7-4128-b53f-7239e557b5c3', '8028549e-95aa-4f6b-bb5f-6d655788c8c3'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:24:12.479458 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-972ecfd1-1436-4c02-875e-03bfb6b62365 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Delete snapshot completed successfully. Nov 10 04:24:12.486700 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-972ecfd1-1436-4c02-875e-03bfb6b62365 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Lock "b'cinder-d926e095-852f-42dd-a62b-ae603a2a81dd-delete_snapshot'" released by "delete_snapshot" :: held 0.956s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:24:12.698311 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Lock "b'cinder-bc3c4203-7d1b-4653-8736-066d076dc6b9-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:24:12.760531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:12.845511 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:24:12.846521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Volume volume-bc3c4203-7d1b-4653-8736-066d076dc6b9 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:24:12.868245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] deleting rbd volume volume-bc3c4203-7d1b-4653-8736-066d076dc6b9 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:24:13.336658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Created reservations ['2a4607a2-2987-4948-8ab8-d6274a8da48d', 'caa42488-bc4c-4d42-95e2-8da4dae0824e', '0ac71c8a-af12-4ae5-80b7-cebf6f8d86a8', '3b1f70b8-aec8-4d20-a040-fd2b8410ed01'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:24:13.392789 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:13.454203 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:13.531670 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:24:13.537329 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Deleted volume successfully. Nov 10 04:24:13.553931 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a8fc94b8-6882-4a62-a11b-08a5901a00b7 tempest-VolumesSnapshotNegativeTestJSON-1575235372 None] Lock "b'cinder-bc3c4203-7d1b-4653-8736-066d076dc6b9-delete_volume'" released by "delete_volume" :: held 0.856s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:24:23.689336 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-c1b13347-abc2-471b-8db1-c6a90d87e028 tempest-TestVolumeBootPattern-1790488751 None] Terminate volume connection completed successfully. Nov 10 04:24:23.690075 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-c1b13347-abc2-471b-8db1-c6a90d87e028 tempest-TestVolumeBootPattern-1790488751 None] Deleting attachment 0046bc79-125c-4495-b19e-e9e6a8127ad8. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:24:23.929785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-b3fb6409-41ae-42f0-878b-4d6d6fd0909f-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:24:23.992875 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:24.162491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:24:24.194019 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] deleting rbd volume volume-b3fb6409-41ae-42f0-878b-4d6d6fd0909f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:24:25.038403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['ca537291-bf5e-4eed-ac75-3862394e60f8', '43464c4a-0042-4cc3-9244-831326fdd63d', 'd577a910-f6b1-45d7-afb3-4ff98bc59ed7', '84bc4d2d-a0de-4fbb-8fad-51756d32c02a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:24:25.147607 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:25.222927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:25.301232 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:24:25.308093 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] Deleted volume successfully. Nov 10 04:24:25.354181 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-d5778469-e156-4b45-99d2-3c86e1edb625 req-ba27b926-37ff-4bd6-a9fb-88cb3f4bba3d tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-b3fb6409-41ae-42f0-878b-4d6d6fd0909f-delete_volume'" released by "delete_volume" :: held 1.422s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:24:25.954449 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-af00cdea-a17f-4abe-a82e-b7297e65a7b5 tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-c4a5a651-a487-40b1-b5fd-dd43729374f1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:24:25.958222 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-af00cdea-a17f-4abe-a82e-b7297e65a7b5 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:28.562963 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:24:28.565623 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:28.611189 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:28.678127 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:24:56.313102 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-af00cdea-a17f-4abe-a82e-b7297e65a7b5 tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['b641026d-68f9-47d6-96ac-8e315fef4490', 'c53e64d2-6df5-4d2c-b201-c76513ee42fb', '9cc2a676-c11e-415d-bc78-790372e5a87b', '6241290f-3141-42e8-bbe1-727240d5d9bc'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:24:56.368922 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-af00cdea-a17f-4abe-a82e-b7297e65a7b5 tempest-TestVolumeBootPattern-1790488751 None] Delete snapshot completed successfully. Nov 10 04:24:56.374769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-af00cdea-a17f-4abe-a82e-b7297e65a7b5 tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-c4a5a651-a487-40b1-b5fd-dd43729374f1-delete_snapshot'" released by "delete_snapshot" :: held 30.420s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:24:59.276684 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-db038400-af11-4aaa-a0e9-c2d8f79d6944 tempest-TestVolumeBootPattern-1790488751 None] Terminate volume connection completed successfully. Nov 10 04:24:59.276684 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-db038400-af11-4aaa-a0e9-c2d8f79d6944 tempest-TestVolumeBootPattern-1790488751 None] Deleting attachment 93037deb-2aaa-4da7-ba80-f7f60cb72dda. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:24:59.484023 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-8afe0bbd-39ee-4262-a035-187190eab4c0-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:24:59.554040 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:24:59.673301 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:24:59.685359 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] deleting rbd volume volume-8afe0bbd-39ee-4262-a035-187190eab4c0 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:25:00.069742 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:25:00.115797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] deleting parent snapshot volume-8afe0bbd-39ee-4262-a035-187190eab4c0.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:25:00.919366 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['2b93d1d6-6814-4b92-82e7-bc308ff394e3', '023ef082-fdbb-4a31-a376-574c48c904d5', 'e44ac1ab-e8c8-4354-be0c-708c880045ec', 'fc357fbb-b9f6-4c74-bb7c-43d6ed402321'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:25:01.003825 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:25:01.068689 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:25:01.124413 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:25:01.130372 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] Deleted volume successfully. Nov 10 04:25:01.151143 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-c437f9d7-9f93-49f4-8a84-1535a7ac3f37 req-965a6490-8517-4270-a592-a575604a0bbd tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-8afe0bbd-39ee-4262-a035-187190eab4c0-delete_volume'" released by "delete_volume" :: held 1.669s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:25:06.302896 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:25:06.315455 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:25:06.316720 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:25:06.350637 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (aaea2cee-522c-4572-b368-6bf06d5cc2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:25:06.355188 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d14467d-cdcf-44aa-82a6-8a906dea4799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:25:06.372253 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:25:06.414633 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d14467d-cdcf-44aa-82a6-8a906dea4799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-248947080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=1f0456af-a5ae-45df-97be-67c7aa662827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be6c4098d8d4e41954d19a88075cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:25:06Z,use_quota=True,user_id='0ab02363def54c2baaf0c83f5377e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:25:06.417749 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f17321-0213-413b-9815-1e106abec10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:25:06.420126 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f17321-0213-413b-9815-1e106abec10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:25:06.422741 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6884c8c-75dc-4286-b1cd-ab44573e8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:25:06.545627 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6884c8c-75dc-4286-b1cd-ab44573e8743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f0456af-a5ae-45df-97be-67c7aa662827', 'volume_name': 'volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:25:06.548298 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ba54e0-9f29-4702-b52b-9c44303a729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:25:06.550412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ba54e0-9f29-4702-b52b-9c44303a729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:25:06.553726 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a89b2d4-48e6-45fa-885b-647898a15157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:25:06.558195 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Volume 1f0456af-a5ae-45df-97be-67c7aa662827: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 04:25:06.558789 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Cloning 1f0456af-a5ae-45df-97be-67c7aa662827 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 04:25:06.573498 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:25:06.593061 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 25, 6, 584244)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:25:06.594059 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:25:06.594905 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 04:25:06.602804 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.029s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:25:06.604045 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 04:25:06.611303 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 4, 25, 6, 608184)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 04:25:06.611672 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 04:25:06.612080 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 04:25:06.626355 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:25:06.745469 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] creating snapshot='volume-1f0456af-a5ae-45df-97be-67c7aa662827.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:25:06.881811 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-1f0456af-a5ae-45df-97be-67c7aa662827.clone_snap' to 'volume-1f0456af-a5ae-45df-97be-67c7aa662827' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:25:07.044578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:25:07.045918 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:25:07.046342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:25:07.062850 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:25:07.063465 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Marking volume 1f0456af-a5ae-45df-97be-67c7aa662827 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:25:07.071787 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 1f0456af-a5ae-45df-97be-67c7aa662827. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 04:25:07.072160 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Creating volume glance metadata for volume 1f0456af-a5ae-45df-97be-67c7aa662827 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 04:25:07.122950 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a89b2d4-48e6-45fa-885b-647898a15157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:25:07.125510 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3ce08b-5af5-48d9-8034-736dc95331bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:25:07.145028 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Volume volume-1f0456af-a5ae-45df-97be-67c7aa662827 (1f0456af-a5ae-45df-97be-67c7aa662827): created successfully Nov 10 04:25:07.147095 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3ce08b-5af5-48d9-8034-736dc95331bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:25:07.150247 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (aaea2cee-522c-4572-b368-6bf06d5cc2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:25:07.158324 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7492ea29-f939-48ab-8cdd-2013764de19c tempest-TestVolumeBootPattern-1790488751 None] Created volume successfully. Nov 10 04:25:10.637326 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-17816e80-0aa1-4713-9f3b-d406b8cc694b req-c7c44c0e-5579-4a55-a77a-70e6d938ff2b tempest-TestVolumeBootPattern-1790488751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:25:11.718812 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-17816e80-0aa1-4713-9f3b-d406b8cc694b req-c7c44c0e-5579-4a55-a77a-70e6d938ff2b tempest-TestVolumeBootPattern-1790488751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.081s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:25:11.719531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-17816e80-0aa1-4713-9f3b-d406b8cc694b req-c7c44c0e-5579-4a55-a77a-70e6d938ff2b tempest-TestVolumeBootPattern-1790488751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '1f0456af-a5ae-45df-97be-67c7aa662827', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:25:11.764801 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-17816e80-0aa1-4713-9f3b-d406b8cc694b req-c7c44c0e-5579-4a55-a77a-70e6d938ff2b tempest-TestVolumeBootPattern-1790488751 None] Connection info returned from driver {'name': 'volumes/volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f0456af-a5ae-45df-97be-67c7aa662827', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1abe53be-5927-4be7-a3b9-e650b8edb024'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:25:11.827515 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-17816e80-0aa1-4713-9f3b-d406b8cc694b req-c7c44c0e-5579-4a55-a77a-70e6d938ff2b tempest-TestVolumeBootPattern-1790488751 None] attachment_update completed successfully. Nov 10 04:25:28.564822 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:25:28.566622 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:25:28.644412 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:25:28.689697 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:26:28.561520 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:26:28.562857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:28.602523 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:28.649168 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:26:41.102104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:26:41.108139 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:26:41.108666 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:26:41.129122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Flow 'volume_create_manager' (c4310689-226d-42c0-a446-a1b7aeb41d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:26:41.135249 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25f1f3d-fb43-4e71-8540-937e8fb1b1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:41.145402 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:26:41.162887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25f1f3d-fb43-4e71-8540-937e8fb1b1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1179277737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=caea6f2b-7290-49a3-b4a8-735c5996301a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981192c29b204493b01f914076270be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:26:41Z,use_quota=True,user_id='f99895ae83414974b2f461b454643c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:41.166056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c944b0d2-c188-4647-8183-2c15deec6de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:41.168769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c944b0d2-c188-4647-8183-2c15deec6de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:41.171630 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd26e1e-19bc-48f6-bbd0-aece3bd1097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:41.173864 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd26e1e-19bc-48f6-bbd0-aece3bd1097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caea6f2b-7290-49a3-b4a8-735c5996301a', 'volume_name': 'volume-caea6f2b-7290-49a3-b4a8-735c5996301a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:41.176394 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae3b3e9-fd10-414a-8f9c-f7b31cc76cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:41.179195 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae3b3e9-fd10-414a-8f9c-f7b31cc76cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:41.182093 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cc7d78-f93d-4b76-aa34-30ab2bdb44fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:41.183659 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume caea6f2b-7290-49a3-b4a8-735c5996301a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caea6f2b-7290-49a3-b4a8-735c5996301a', 'volume_size': 1} Nov 10 04:26:41.184078 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] creating volume 'volume-caea6f2b-7290-49a3-b4a8-735c5996301a' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:26:41.185344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:41.269304 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:26:41.269681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:26:41.271772 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cc7d78-f93d-4b76-aa34-30ab2bdb44fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caea6f2b-7290-49a3-b4a8-735c5996301a', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:41.274300 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf90b7e-98f8-4f10-b677-8e022f3072f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:41.283811 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume volume-caea6f2b-7290-49a3-b4a8-735c5996301a (caea6f2b-7290-49a3-b4a8-735c5996301a): created successfully Nov 10 04:26:41.286577 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf90b7e-98f8-4f10-b677-8e022f3072f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:41.290927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Flow 'volume_create_manager' (c4310689-226d-42c0-a446-a1b7aeb41d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:26:41.302132 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-42b4f87d-e322-438c-a447-934f1cd6ece0 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Created volume successfully. Nov 10 04:26:42.254759 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Lock "b'cinder-caea6f2b-7290-49a3-b4a8-735c5996301a-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:26:42.315949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:42.376207 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:26:42.376820 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume volume-caea6f2b-7290-49a3-b4a8-735c5996301a is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:26:42.391068 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] deleting rbd volume volume-caea6f2b-7290-49a3-b4a8-735c5996301a {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:26:42.771646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Created reservations ['75d6ab8f-a154-4724-a4a8-97aaf7a7a4fc', '3e4d5526-0c2a-432e-990d-792945afe445', '00426049-3c23-492a-a462-3835d38adbee', '47caaeab-1436-4099-8a4f-23a7ae6dfe17'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:26:42.842399 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:42.884782 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:42.924346 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:26:42.931692 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Deleted volume successfully. Nov 10 04:26:42.947772 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-85db9e53-359f-4269-be93-b0dcd990f1a4 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Lock "b'cinder-caea6f2b-7290-49a3-b4a8-735c5996301a-delete_volume'" released by "delete_volume" :: held 0.693s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:26:43.952555 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:26:43.958577 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:26:43.959990 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:26:43.988027 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Flow 'volume_create_manager' (46c7de5f-1941-46d9-9459-89cc9aa192f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:26:43.992234 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695a1094-d285-43be-b256-7429860197a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:44.001081 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:26:44.014108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695a1094-d285-43be-b256-7429860197a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-812598614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=736c614b-14e8-4857-bbce-6973c808cb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981192c29b204493b01f914076270be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:26:44Z,use_quota=True,user_id='f99895ae83414974b2f461b454643c21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:44.016857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbfd3f0-291f-415e-874a-f063c11773c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:44.019231 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbfd3f0-291f-415e-874a-f063c11773c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:44.022363 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab58c3a-1a1a-430d-8c16-9d86717a5e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:44.024827 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab58c3a-1a1a-430d-8c16-9d86717a5e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736c614b-14e8-4857-bbce-6973c808cb7e', 'volume_name': 'volume-736c614b-14e8-4857-bbce-6973c808cb7e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:44.027192 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59538c88-e394-42c9-b38c-3c5d6fc3500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:44.029623 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59538c88-e394-42c9-b38c-3c5d6fc3500b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:44.031916 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670ec1b6-c307-4d8d-b091-474f078b75ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:44.032850 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume 736c614b-14e8-4857-bbce-6973c808cb7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736c614b-14e8-4857-bbce-6973c808cb7e', 'volume_size': 1} Nov 10 04:26:44.033479 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] creating volume 'volume-736c614b-14e8-4857-bbce-6973c808cb7e' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:26:44.034584 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:44.130488 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:26:44.130936 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:26:44.133286 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670ec1b6-c307-4d8d-b091-474f078b75ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736c614b-14e8-4857-bbce-6973c808cb7e', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:44.136402 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031f7212-8e72-4341-bb5b-8b4329bcbd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:44.151630 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Volume volume-736c614b-14e8-4857-bbce-6973c808cb7e (736c614b-14e8-4857-bbce-6973c808cb7e): created successfully Nov 10 04:26:44.155870 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031f7212-8e72-4341-bb5b-8b4329bcbd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:44.161796 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Flow 'volume_create_manager' (46c7de5f-1941-46d9-9459-89cc9aa192f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:26:44.174879 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-98c50d9c-b438-4360-be35-8c43d24888b5 tempest-VolumeQuotasAdminTestJSON-1860003930 None] Created volume successfully. Nov 10 04:26:45.972908 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f36af199-987c-4a2d-9469-85ca3a20259f tempest-VolumeQuotasAdminTestJSON-1601241056 None] Transfer volume completed successfully. Nov 10 04:26:46.467556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] Lock "b'cinder-736c614b-14e8-4857-bbce-6973c808cb7e-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:26:46.569878 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:46.659960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:26:46.661246 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] Volume volume-736c614b-14e8-4857-bbce-6973c808cb7e is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:26:46.679040 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] deleting rbd volume volume-736c614b-14e8-4857-bbce-6973c808cb7e {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:26:47.110162 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] Created reservations ['1077495d-927a-4fe1-8f11-c6becb94a132', '03e52cc3-24a8-49fe-937d-09bfb31842b6', '0ad8ca83-a6ad-4a1d-8b03-ec95c198931a', 'e8f88c44-1d73-4e41-8139-f45891c7a9bd'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:26:47.183085 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:47.250962 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:47.330767 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:26:47.337219 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] Deleted volume successfully. Nov 10 04:26:47.354102 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2d2f92d3-1e82-4f7b-95ee-a754a41b122e tempest-VolumeQuotasAdminTestJSON-1858331480 None] Lock "b'cinder-736c614b-14e8-4857-bbce-6973c808cb7e-delete_volume'" released by "delete_volume" :: held 0.887s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:26:53.300720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:26:53.305479 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:26:53.306124 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:26:53.319344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Flow 'volume_create_manager' (4ee81215-ba41-4707-b732-d3ce05cd0d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:26:53.322587 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452265b7-67b9-400c-8453-a0cb88be8ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:53.330548 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:26:53.343819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452265b7-67b9-400c-8453-a0cb88be8ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1460304529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=5b2242e2-fb53-444f-8ab0-23bf273f5a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c794d7d2a054da5a7a201add4a1e14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:26:53Z,use_quota=True,user_id='448b421c6afb4e618ee5eb162cede9a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:53.346534 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba41eea-a5d8-486c-8c64-762765927edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:53.349329 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba41eea-a5d8-486c-8c64-762765927edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:53.361392 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b856d19-e10e-4bf3-acdc-91ab184726f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:53.364198 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b856d19-e10e-4bf3-acdc-91ab184726f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2242e2-fb53-444f-8ab0-23bf273f5a30', 'volume_name': 'volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:53.366692 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f73632-a022-4591-af48-c8c1e7819824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:53.368817 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f73632-a022-4591-af48-c8c1e7819824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:53.370959 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c636bc8-7394-4b97-b274-848624f267fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:53.371893 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Volume 5b2242e2-fb53-444f-8ab0-23bf273f5a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30', 'volume_size': 1} Nov 10 04:26:53.372288 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] creating volume 'volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:26:53.373313 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:53.442800 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:26:53.443097 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:26:53.445356 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c636bc8-7394-4b97-b274-848624f267fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:53.447724 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a56aa42-9a01-491d-84e2-b92fe84e08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:26:53.458296 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Volume volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30 (5b2242e2-fb53-444f-8ab0-23bf273f5a30): created successfully Nov 10 04:26:53.463357 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a56aa42-9a01-491d-84e2-b92fe84e08af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:26:53.467450 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Flow 'volume_create_manager' (4ee81215-ba41-4707-b732-d3ce05cd0d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:26:53.480467 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2b080454-930f-4ced-a013-bf18d9af0a64 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Created volume successfully. Nov 10 04:26:54.508504 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-50cac75b-2f74-4b42-a9ad-22cd028c3059 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:54.722100 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-50cac75b-2f74-4b42-a9ad-22cd028c3059 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Create snapshot completed successfully Nov 10 04:26:55.993181 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-6191ad40-32d3-4f7f-adf6-4549a0a66142 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Lock "b'cinder-cb480244-c20f-4538-8571-36a8e771bab8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:26:55.994581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6191ad40-32d3-4f7f-adf6-4549a0a66142 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:56.793682 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-6191ad40-32d3-4f7f-adf6-4549a0a66142 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Created reservations ['b4988ee4-0707-4fc3-a6d2-a71ba248e156', '18047d06-9295-4e27-9f38-4bf85e57056c', '32b5388e-bc42-4ffe-be04-bd5d0554621e', 'c9c3df8d-4997-4152-91c3-f6ec3751c1c4'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:26:56.847504 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6191ad40-32d3-4f7f-adf6-4549a0a66142 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Delete snapshot completed successfully. Nov 10 04:26:56.855581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-6191ad40-32d3-4f7f-adf6-4549a0a66142 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Lock "b'cinder-cb480244-c20f-4538-8571-36a8e771bab8-delete_snapshot'" released by "delete_snapshot" :: held 0.862s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:26:57.106201 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Lock "b'cinder-5b2242e2-fb53-444f-8ab0-23bf273f5a30-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:26:57.155692 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:57.215864 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:26:57.216390 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Volume volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:26:57.221520 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] deleting rbd volume volume-5b2242e2-fb53-444f-8ab0-23bf273f5a30 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:26:57.460228 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Created reservations ['5b3ad40e-1ec8-4cc2-9cea-3d01593c69a1', 'e278e239-c4f3-4491-a70d-322912116bac', '8fb99a30-7e23-4d3b-9d78-6dfc776dd506', 'abd26af0-1848-4719-baf3-7571f6807074'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:26:57.506143 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:57.530771 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:26:57.556489 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:26:57.561211 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Deleted volume successfully. Nov 10 04:26:57.573535 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0cbc57a8-f7a7-4a65-a5c1-4483a82a40a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-722389151 None] Lock "b'cinder-5b2242e2-fb53-444f-8ab0-23bf273f5a30-delete_volume'" released by "delete_volume" :: held 0.468s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:01.677224 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:27:01.680810 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:27:01.681258 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:27:01.695104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Flow 'volume_create_manager' (e1d84467-25c3-4ebd-bc7a-4a47c34c1fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:01.698306 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583ecc5c-8115-4b7b-9fe3-e16c21d07d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:01.704761 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:27:01.717227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583ecc5c-8115-4b7b-9fe3-e16c21d07d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-136524706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=ef9710e0-7ba9-4d0f-a737-61c1a9dac93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2bec88ac5a4e3fa172314f7affc087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:27:02Z,use_quota=True,user_id='42a088840e30422680a094a10829bf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:01.719820 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b201023-8453-4116-a8cf-5ac80dbd27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:01.721929 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b201023-8453-4116-a8cf-5ac80dbd27b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:01.724790 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165f982f-f27a-45d6-8f49-edd662655c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:01.726947 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165f982f-f27a-45d6-8f49-edd662655c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9710e0-7ba9-4d0f-a737-61c1a9dac93f', 'volume_name': 'volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:01.729363 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1957e1f2-2cfe-4b78-b508-4c81c50896ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:01.731407 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1957e1f2-2cfe-4b78-b508-4c81c50896ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:01.733744 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e9315c-00cf-4375-8d9d-f8cb8367336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:01.734441 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Volume ef9710e0-7ba9-4d0f-a737-61c1a9dac93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f', 'volume_size': 1} Nov 10 04:27:01.734818 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] creating volume 'volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:27:01.735819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:01.786913 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:01.787201 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:01.789256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e9315c-00cf-4375-8d9d-f8cb8367336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:01.791400 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33cd5db-29df-4246-bbd7-39016c247487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:01.806123 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Volume volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f (ef9710e0-7ba9-4d0f-a737-61c1a9dac93f): created successfully Nov 10 04:27:01.808294 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33cd5db-29df-4246-bbd7-39016c247487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:01.811183 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Flow 'volume_create_manager' (e1d84467-25c3-4ebd-bc7a-4a47c34c1fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:01.820694 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-957bcac2-89b3-498c-b017-ab3f07b15248 tempest-VolumesBackupsAdminTest-2123084135 None] Created volume successfully. Nov 10 04:27:03.017942 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-1a46fe72-9ad8-4ab5-a62f-d4615bff1374 tempest-VolumesBackupsAdminTest-2123084135 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:27:03.697843 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-1a46fe72-9ad8-4ab5-a62f-d4615bff1374 tempest-VolumesBackupsAdminTest-2123084135 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.680s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:27:03.698803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-1a46fe72-9ad8-4ab5-a62f-d4615bff1374 tempest-VolumesBackupsAdminTest-2123084135 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'ef9710e0-7ba9-4d0f-a737-61c1a9dac93f', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:27:03.716422 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1a46fe72-9ad8-4ab5-a62f-d4615bff1374 tempest-VolumesBackupsAdminTest-2123084135 None] Initialize volume connection completed successfully. Nov 10 04:27:05.686750 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1a46fe72-9ad8-4ab5-a62f-d4615bff1374 tempest-VolumesBackupsAdminTest-2123084135 None] Terminate volume connection completed successfully. Nov 10 04:27:05.703406 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-1a46fe72-9ad8-4ab5-a62f-d4615bff1374 tempest-VolumesBackupsAdminTest-2123084135 None] Remove volume export completed successfully. Nov 10 04:27:07.701137 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:27:07.705760 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:27:07.706259 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:27:07.718780 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Flow 'volume_create_manager' (350d9888-0f00-43d9-b8f6-a96bdd7da935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:07.722000 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d129ae1-79d2-4a7e-bfc0-58a7221d59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:07.729187 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:27:07.742183 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d129ae1-79d2-4a7e-bfc0-58a7221d59a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:27:08Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_c79ad7c7-e609-4ff6-9c72-4daee355890b',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=a78d6171-02e2-46a0-a1bd-3f990aa2e532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2bec88ac5a4e3fa172314f7affc087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:27:08Z,use_quota=True,user_id='42a088840e30422680a094a10829bf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:07.744852 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c77c27-1844-422b-a339-9c900409c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:07.746927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c77c27-1844-422b-a339-9c900409c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:07.749269 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168a6ce9-0cc2-4334-968f-c9b24e965d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:07.751545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168a6ce9-0cc2-4334-968f-c9b24e965d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78d6171-02e2-46a0-a1bd-3f990aa2e532', 'volume_name': 'volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:07.753819 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eace80d0-1c95-4b7c-a2c8-10dce50ed73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:07.755887 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eace80d0-1c95-4b7c-a2c8-10dce50ed73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:07.758038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f593010c-165e-419f-9330-bbdeb00754d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:07.758803 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Volume a78d6171-02e2-46a0-a1bd-3f990aa2e532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532', 'volume_size': 1} Nov 10 04:27:07.759198 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] creating volume 'volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:27:07.760290 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:07.819308 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:07.819775 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:07.821890 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f593010c-165e-419f-9330-bbdeb00754d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:07.824033 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d1b790-c588-4899-baca-69f2ab09566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:07.834420 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Volume volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532 (a78d6171-02e2-46a0-a1bd-3f990aa2e532): created successfully Nov 10 04:27:07.836374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d1b790-c588-4899-baca-69f2ab09566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:07.839372 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Flow 'volume_create_manager' (350d9888-0f00-43d9-b8f6-a96bdd7da935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:07.847029 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Created volume successfully. Nov 10 04:27:08.775384 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:27:09.432395 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.657s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:27:09.433256 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'a78d6171-02e2-46a0-a1bd-3f990aa2e532', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:27:09.450739 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Initialize volume connection completed successfully. Nov 10 04:27:10.044292 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e946a59b-a177-4ff8-bd1d-6614ce8a328f tempest-GroupsV314Test-1455050946 None] Group tempest-GroupsV314Test-Group-520186009: creating Nov 10 04:27:10.059677 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e946a59b-a177-4ff8-bd1d-6614ce8a328f tempest-GroupsV314Test-1455050946 None] Group tempest-GroupsV314Test-Group-520186009: created successfully Nov 10 04:27:10.071187 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-e946a59b-a177-4ff8-bd1d-6614ce8a328f tempest-GroupsV314Test-1455050946 None] Create group completed successfully. Nov 10 04:27:10.904216 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Terminate volume connection completed successfully. Nov 10 04:27:10.918983 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f7005fec-5678-40c5-ac65-db427cb5b6be tempest-VolumesBackupsAdminTest-2123084135 None] Remove volume export completed successfully. Nov 10 04:27:11.391995 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:27:11.396507 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:27:11.397044 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:27:11.409586 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Flow 'volume_create_manager' (41c3cc6d-553e-4aa8-bc87-0666ee389bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:11.413165 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791512d2-b5aa-4ee2-a4f3-e968f17b3bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:11.419630 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:27:11.431929 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791512d2-b5aa-4ee2-a4f3-e968f17b3bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-928661445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa33552f-91cb-4ba5-b413-3ed563057fec,host='ncdv-817176-1@ceph#ceph',id=7ca12d0a-d1eb-4aec-9578-6a7510f97a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25dd7221e1f48e0a55a68ea0c35e199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:27:11Z,use_quota=True,user_id='72ee397c38674679a33f16c9d40f52b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98d6b16a-7605-4a2f-b599-1b6cd7c17f41),volume_type_id=98d6b16a-7605-4a2f-b599-1b6cd7c17f41)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:11.434456 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1e82dd-5af8-4df7-9d93-020e4ea9bd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:11.436572 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1e82dd-5af8-4df7-9d93-020e4ea9bd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:11.438955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612e5c4d-2724-4365-b1aa-f22cc86741d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:11.441713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612e5c4d-2724-4365-b1aa-f22cc86741d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca12d0a-d1eb-4aec-9578-6a7510f97a1f', 'volume_name': 'volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:11.443963 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d02602f-eeaa-4226-90ed-a0c0974ca4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:11.446098 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d02602f-eeaa-4226-90ed-a0c0974ca4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:11.448263 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc2a236-1954-463f-99df-57ca79c1918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:11.462135 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Volume 7ca12d0a-d1eb-4aec-9578-6a7510f97a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f', 'volume_size': 1} Nov 10 04:27:11.462546 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] creating volume 'volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:27:11.463659 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:11.513966 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:11.514348 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:11.516380 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc2a236-1954-463f-99df-57ca79c1918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:11.518543 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f2b558-2429-4b02-8370-70f30a20446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:11.528003 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Volume volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f (7ca12d0a-d1eb-4aec-9578-6a7510f97a1f): created successfully Nov 10 04:27:11.529785 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f2b558-2429-4b02-8370-70f30a20446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:11.532626 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Flow 'volume_create_manager' (41c3cc6d-553e-4aa8-bc87-0666ee389bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:11.539934 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-321120b2-47fb-425f-a8cd-01e56fac1760 tempest-GroupsV314Test-1455050946 None] Created volume successfully. Nov 10 04:27:11.940655 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] Lock "b'cinder-a78d6171-02e2-46a0-a1bd-3f990aa2e532-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:27:11.971860 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:12.766272 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] Volume volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:12.782577 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] deleting rbd volume volume-a78d6171-02e2-46a0-a1bd-3f990aa2e532 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:12.838212 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:12.891795 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] creating snapshot='volume-7f2ba888-aeed-42b2-8835-4d05c490507e.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 04:27:13.812633 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] cloning 'volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f@volume-7f2ba888-aeed-42b2-8835-4d05c490507e.clone_snap' to 'volume-7f2ba888-aeed-42b2-8835-4d05c490507e' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 04:27:13.861500 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] Created reservations ['0efe29f0-ee60-420e-b2e3-da1f9719527f', 'f500d56b-1a3c-4342-87ff-d75f0f6e4bc8', '07244bdb-c213-4be7-801e-4e0402b6cd56', 'a6f28a49-b441-4bbe-9ea6-b0e03728a5ba'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:13.908124 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:13.934553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:13.961101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:13.978272 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] Volume volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:13.987138 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] Deleted volume successfully. Nov 10 04:27:13.993238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] extra_specs: {} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:13.993786 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] extra_specs: {} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:14.018779 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 04:27:14.039499 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-38944051-6055-46be-ba3f-861c7356df61 tempest-VolumesBackupsAdminTest-2123084135 None] Lock "b'cinder-a78d6171-02e2-46a0-a1bd-3f990aa2e532-delete_volume'" released by "delete_volume" :: held 2.099s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:14.077324 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-27f80643-355b-4cb0-a34d-8111b45af45a tempest-GroupsV314Test-1455050946 None] Create group from source-group-aa33552f-91cb-4ba5-b413-3ed563057fec completed successfully. Nov 10 04:27:15.385253 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:15.443593 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:27:15.449234 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] deleting rbd volume volume-7f2ba888-aeed-42b2-8835-4d05c490507e {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:15.470721 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:27:15.474384 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:27:15.474867 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:27:15.487521 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Flow 'volume_create_manager' (4233cb99-1c32-411f-8139-e70df34d5dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:15.491861 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a6da4d-e19e-43c4-8d36-5c630218ecc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:15.498736 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:27:15.511931 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a6da4d-e19e-43c4-8d36-5c630218ecc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1566201653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=2326d381-fd5e-45e7-9597-287caa95ec86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2bec88ac5a4e3fa172314f7affc087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:27:15Z,use_quota=True,user_id='42a088840e30422680a094a10829bf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:15.514487 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d127fd1-98f9-4595-835a-bb9494a8f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:15.516599 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d127fd1-98f9-4595-835a-bb9494a8f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:15.519024 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8442c317-7f71-4bf4-aab8-056323087c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:15.521291 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8442c317-7f71-4bf4-aab8-056323087c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2326d381-fd5e-45e7-9597-287caa95ec86', 'volume_name': 'volume-2326d381-fd5e-45e7-9597-287caa95ec86', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:15.523637 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df8a015-58e9-4b4b-b482-ebfd7e9aefd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:15.525738 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df8a015-58e9-4b4b-b482-ebfd7e9aefd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:15.527888 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcc8b6e-5dba-4221-ad4a-ed48163bc0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:15.528694 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Volume 2326d381-fd5e-45e7-9597-287caa95ec86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2326d381-fd5e-45e7-9597-287caa95ec86', 'volume_size': 1} Nov 10 04:27:15.529104 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] creating volume 'volume-2326d381-fd5e-45e7-9597-287caa95ec86' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:27:15.530089 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:15.588882 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:15.589248 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:15.591164 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcc8b6e-5dba-4221-ad4a-ed48163bc0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2326d381-fd5e-45e7-9597-287caa95ec86', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:15.593374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c1cfee-49fb-4068-a75c-699667cc1919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:15.601729 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Volume volume-2326d381-fd5e-45e7-9597-287caa95ec86 (2326d381-fd5e-45e7-9597-287caa95ec86): created successfully Nov 10 04:27:15.603562 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c1cfee-49fb-4068-a75c-699667cc1919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:15.606523 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Flow 'volume_create_manager' (4233cb99-1c32-411f-8139-e70df34d5dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:15.614588 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8ae15d34-7db6-4de3-ae84-d93146c299bc tempest-VolumesBackupsAdminTest-2123084135 None] Created volume successfully. Nov 10 04:27:15.637448 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:27:15.655695 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Volume volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:15.656278 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] deleting parent snapshot volume-7f2ba888-aeed-42b2-8835-4d05c490507e.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:27:15.851397 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Created reservations ['4229cfc1-65b5-4929-b01b-c829c9b3d375'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:15.867234 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1863569467 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1863569467, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:27:15.868026 ncdv-817176-1 cinder-volume[127842]: WARNING cinder.quota [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1863569467 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1863569467, it is now deprecated. Please use the default quota class for default quota. Nov 10 04:27:15.881831 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Created reservations ['070ecc74-2aba-4774-9df9-58e5bff198ff', '207f7f71-1a5f-4e7f-a5fb-4c039cf161c0', 'f1339b72-6435-44f3-9874-a457233da75e', '1c1a831c-e14b-4f84-b79a-189f21f445f8'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:15.949343 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:15.971419 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:15.993581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:15.997762 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-8ad2a9e8-86c5-4814-9791-cd79c4aa864b tempest-GroupsV314Test-1455050946 None] Delete group completed successfully. Nov 10 04:27:16.677312 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:16.717825 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:27:16.718353 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] Volume volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:16.724853 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] deleting rbd volume volume-7ca12d0a-d1eb-4aec-9578-6a7510f97a1f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:16.742177 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-93092fd1-e003-4fad-a8b8-6ac0edb39d83 tempest-VolumesBackupsAdminTest-2123084135 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:27:17.030270 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] Created reservations ['a49e5cf1-ad7c-40e0-8cda-19fca983642a'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:17.062021 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] Created reservations ['65902027-5aca-4c68-94e2-a8d44bf3643d', '580adc56-25fe-4315-aba6-02b1e2c46ada', '33d1a080-20fc-454e-a4d6-cf5852eadd6a', '9501a12e-e973-46af-9474-2b326806ae9e'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:17.133567 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:17.160347 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:17.183972 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:17.189071 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-45fb98a1-74be-43a8-8924-c54ae08a16ac tempest-GroupsV314Test-1455050946 None] Delete group completed successfully. Nov 10 04:27:17.407070 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-93092fd1-e003-4fad-a8b8-6ac0edb39d83 tempest-VolumesBackupsAdminTest-2123084135 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.665s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:27:17.407909 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-93092fd1-e003-4fad-a8b8-6ac0edb39d83 tempest-VolumesBackupsAdminTest-2123084135 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2326d381-fd5e-45e7-9597-287caa95ec86', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '2326d381-fd5e-45e7-9597-287caa95ec86', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:27:17.419745 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-93092fd1-e003-4fad-a8b8-6ac0edb39d83 tempest-VolumesBackupsAdminTest-2123084135 None] Initialize volume connection completed successfully. Nov 10 04:27:19.678422 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-93092fd1-e003-4fad-a8b8-6ac0edb39d83 tempest-VolumesBackupsAdminTest-2123084135 None] Terminate volume connection completed successfully. Nov 10 04:27:19.693760 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-93092fd1-e003-4fad-a8b8-6ac0edb39d83 tempest-VolumesBackupsAdminTest-2123084135 None] Remove volume export completed successfully. Nov 10 04:27:21.577477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:27:21.582309 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:27:21.582979 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:27:21.599050 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Flow 'volume_create_manager' (9c39af4a-df10-4356-83ee-7b08e95ba465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:21.602549 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0109d6a3-5469-4d9d-ada3-2db66129a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:21.609198 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:27:21.622581 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0109d6a3-5469-4d9d-ada3-2db66129a69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-2070531934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=086f3e54-f747-446a-929a-167b2a96c199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cd374865df4bfca5328af93dee89eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:27:22Z,use_quota=True,user_id='8df8815ae5ea461692190a95baf2ccce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:21.626322 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450cc0bd-3628-47bb-9f01-c7ebf2a4f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:21.629502 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450cc0bd-3628-47bb-9f01-c7ebf2a4f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:21.632834 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090e1994-1908-4e23-acac-9043f00c92f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:21.635227 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090e1994-1908-4e23-acac-9043f00c92f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086f3e54-f747-446a-929a-167b2a96c199', 'volume_name': 'volume-086f3e54-f747-446a-929a-167b2a96c199', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:21.638373 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df32d01-0cf7-4e79-8f75-bed83f831e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:21.640883 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df32d01-0cf7-4e79-8f75-bed83f831e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:21.643594 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053cd4bb-a83b-4781-9372-abf709eb8fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:21.645519 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Volume 086f3e54-f747-446a-929a-167b2a96c199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086f3e54-f747-446a-929a-167b2a96c199', 'volume_size': 1} Nov 10 04:27:21.645519 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] creating volume 'volume-086f3e54-f747-446a-929a-167b2a96c199' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:27:21.646935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:21.704868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:21.705264 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:21.708004 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053cd4bb-a83b-4781-9372-abf709eb8fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086f3e54-f747-446a-929a-167b2a96c199', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:21.710153 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23d7513-4bd7-4df4-b050-e49c7b8c2e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:21.718724 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Volume volume-086f3e54-f747-446a-929a-167b2a96c199 (086f3e54-f747-446a-929a-167b2a96c199): created successfully Nov 10 04:27:21.720692 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23d7513-4bd7-4df4-b050-e49c7b8c2e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:21.724101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Flow 'volume_create_manager' (9c39af4a-df10-4356-83ee-7b08e95ba465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:21.732067 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-82f2aa55-a4de-49c2-8c6b-102787d830f8 tempest-VolumesBackupsV39Test-739413831 None] Created volume successfully. Nov 10 04:27:22.821457 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-4a6bd327-a548-4072-9b75-564b2d36c489 tempest-VolumesBackupsV39Test-739413831 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:27:22.951553 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] Lock "b'cinder-2326d381-fd5e-45e7-9597-287caa95ec86-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:27:22.987377 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:23.582629 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] Volume volume-2326d381-fd5e-45e7-9597-287caa95ec86 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:23.595672 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] deleting rbd volume volume-2326d381-fd5e-45e7-9597-287caa95ec86 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:23.598747 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [None req-4a6bd327-a548-4072-9b75-564b2d36c489 tempest-VolumesBackupsV39Test-739413831 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.777s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:27:23.599337 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-4a6bd327-a548-4072-9b75-564b2d36c489 tempest-VolumesBackupsV39Test-739413831 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-086f3e54-f747-446a-929a-167b2a96c199', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '086f3e54-f747-446a-929a-167b2a96c199', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:27:23.611684 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a6bd327-a548-4072-9b75-564b2d36c489 tempest-VolumesBackupsV39Test-739413831 None] Initialize volume connection completed successfully. Nov 10 04:27:23.832434 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] Created reservations ['fdfb29da-69bf-475a-b347-930b6321570f', '09ae020f-8ce4-4f1d-b830-9a8396dc4907', '2b42aba5-01fc-436c-853e-9358de3cd5ce', 'cbc9920d-ae43-47c2-b9ab-29b9abfa4500'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:23.872698 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:23.894594 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:23.917562 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:23.921533 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] Deleted volume successfully. Nov 10 04:27:23.932552 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-5e778a8d-75c9-4481-934d-51a4c173b2e2 tempest-VolumesBackupsAdminTest-2123084135 None] Lock "b'cinder-2326d381-fd5e-45e7-9597-287caa95ec86-delete_volume'" released by "delete_volume" :: held 0.981s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:24.068486 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] Lock "b'cinder-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:27:24.100597 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:24.589897 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] Volume volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:24.618532 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] deleting rbd volume volume-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:24.848495 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] Created reservations ['5f4f41e6-9c30-4629-b37c-ac788d2137b8', '31f26b03-7ddc-488f-b44b-c6bf1b25d7af', '2dca995d-e175-469b-882f-8d642905a5ea', '99b257b2-f05c-488c-b110-0250380ea661'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:24.887635 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:24.910247 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:24.933485 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:24.937457 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] Deleted volume successfully. Nov 10 04:27:24.948571 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2a7b4de4-cf5c-4716-8206-108b6881bad9 tempest-VolumesBackupsAdminTest-2123084135 None] Lock "b'cinder-ef9710e0-7ba9-4d0f-a737-61c1a9dac93f-delete_volume'" released by "delete_volume" :: held 0.880s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:25.732786 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a6bd327-a548-4072-9b75-564b2d36c489 tempest-VolumesBackupsV39Test-739413831 None] Terminate volume connection completed successfully. Nov 10 04:27:25.752034 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-4a6bd327-a548-4072-9b75-564b2d36c489 tempest-VolumesBackupsV39Test-739413831 None] Remove volume export completed successfully. Nov 10 04:27:27.399463 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:27:27.403938 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:27:27.404544 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:27:27.418154 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Flow 'volume_create_manager' (b00f3849-b8be-4675-810e-88ec9b4555ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:27.421158 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6e5cfd-fe55-4871-9506-ebf09a3be0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:27.427923 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:27:27.442744 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6e5cfd-fe55-4871-9506-ebf09a3be0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-384303498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=5d101ef0-1447-4bb1-824d-865d0d608401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6a4f5c910c47a78a079f3112b9b520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:27:27Z,use_quota=True,user_id='ba3fd7c1194445508e397cfce2a32096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:27.445452 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaa7e41-6095-4446-9bb3-2186f2badead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:27.447530 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaa7e41-6095-4446-9bb3-2186f2badead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:27.450240 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfadd20b-3d8f-498a-b700-091bacdbda42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:27.452459 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfadd20b-3d8f-498a-b700-091bacdbda42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d101ef0-1447-4bb1-824d-865d0d608401', 'volume_name': 'volume-5d101ef0-1447-4bb1-824d-865d0d608401', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:27.455014 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6b9898-2636-4914-b1ae-e2cef0b5b9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:27.457132 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6b9898-2636-4914-b1ae-e2cef0b5b9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:27.460050 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c1ceef-b392-4aa7-afc8-f8334983ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:27.460861 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Volume 5d101ef0-1447-4bb1-824d-865d0d608401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d101ef0-1447-4bb1-824d-865d0d608401', 'volume_size': 1} Nov 10 04:27:27.461255 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] creating volume 'volume-5d101ef0-1447-4bb1-824d-865d0d608401' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:27:27.462265 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:27.529069 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:27:27.529746 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:27:27.532152 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c1ceef-b392-4aa7-afc8-f8334983ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d101ef0-1447-4bb1-824d-865d0d608401', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:27.535075 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938ba03a-62f5-411e-a439-0fc7619d8884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:27:27.546452 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Volume volume-5d101ef0-1447-4bb1-824d-865d0d608401 (5d101ef0-1447-4bb1-824d-865d0d608401): created successfully Nov 10 04:27:27.548809 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938ba03a-62f5-411e-a439-0fc7619d8884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:27:27.551803 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Flow 'volume_create_manager' (b00f3849-b8be-4675-810e-88ec9b4555ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:27:27.565926 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-083295ba-e3eb-4e29-bef0-6bd3c562adc3 tempest-SnapshotMetadataTestJSON-1281569960 None] Created volume successfully. Nov 10 04:27:28.563764 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:27:28.564478 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:28.585847 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:28.608219 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:28.619429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-bbc93f82-365c-483e-be63-5f173c171261 tempest-SnapshotMetadataTestJSON-1281569960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:29.111981 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] Lock "b'cinder-086f3e54-f747-446a-929a-167b2a96c199-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:27:29.149265 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:29.679817 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] Volume volume-086f3e54-f747-446a-929a-167b2a96c199 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:29.705720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] deleting rbd volume volume-086f3e54-f747-446a-929a-167b2a96c199 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:29.766040 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-bbc93f82-365c-483e-be63-5f173c171261 tempest-SnapshotMetadataTestJSON-1281569960 None] Create snapshot completed successfully Nov 10 04:27:29.997966 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] Created reservations ['ee5f87bc-ec91-48df-b580-1c12ea05bd78', '9331062f-438f-487e-844b-bf69d046fe93', '259eb2c2-b273-4611-8e3f-ea8ec8980327', '134847a2-830e-41cc-b3d4-1e96f4af1a45'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:30.041024 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:30.066296 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:30.092435 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:30.097614 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] Deleted volume successfully. Nov 10 04:27:30.111319 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-95762636-6a3c-4a50-8ca6-f593bd518fc2 tempest-VolumesBackupsV39Test-739413831 None] Lock "b'cinder-086f3e54-f747-446a-929a-167b2a96c199-delete_volume'" released by "delete_volume" :: held 0.999s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:31.291901 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-6d7e91bd-966e-46d7-a371-079472619812 tempest-SnapshotMetadataTestJSON-1281569960 None] Lock "b'cinder-78f7604b-59e1-423f-b449-addc0418e3a7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:27:31.293558 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-6d7e91bd-966e-46d7-a371-079472619812 tempest-SnapshotMetadataTestJSON-1281569960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:31.824736 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-6d7e91bd-966e-46d7-a371-079472619812 tempest-SnapshotMetadataTestJSON-1281569960 None] Created reservations ['c51a563f-3bb6-4fa0-a9bd-285630100d3b', 'fdc65e25-4870-43bb-9574-88658a72fd47', '731a2270-0e74-44f8-b04a-d813d39935d2', '1091ea97-300a-4af5-acf8-4395650b5a35'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:31.867933 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-6d7e91bd-966e-46d7-a371-079472619812 tempest-SnapshotMetadataTestJSON-1281569960 None] Delete snapshot completed successfully. Nov 10 04:27:31.873765 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-6d7e91bd-966e-46d7-a371-079472619812 tempest-SnapshotMetadataTestJSON-1281569960 None] Lock "b'cinder-78f7604b-59e1-423f-b449-addc0418e3a7-delete_snapshot'" released by "delete_snapshot" :: held 0.582s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:32.408488 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] Lock "b'cinder-5d101ef0-1447-4bb1-824d-865d0d608401-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:27:32.453101 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:32.515807 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:27:32.516242 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] Volume volume-5d101ef0-1447-4bb1-824d-865d0d608401 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:27:32.528573 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] deleting rbd volume volume-5d101ef0-1447-4bb1-824d-865d0d608401 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:27:32.923923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] Created reservations ['dc3b9901-71c0-4334-8176-db242e87c761', '3fc51e51-59d7-4a26-bd24-d0ad270ffeef', '72bf63b1-f0a4-4c71-99e9-e15dea26a3f7', 'dd67d60f-36ac-404c-ada9-026db4e0ef19'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:27:32.970341 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:33.022926 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:27:33.060539 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:27:33.065958 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] Deleted volume successfully. Nov 10 04:27:33.081578 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-2647bbbb-390c-4dd1-a077-61dab907ed4b tempest-SnapshotMetadataTestJSON-1281569960 None] Lock "b'cinder-5d101ef0-1447-4bb1-824d-865d0d608401-delete_volume'" released by "delete_volume" :: held 0.673s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:27:52.004473 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-027fa1ee-aaca-454d-8c0d-48c6914a2bac req-b103d9ac-936f-42bb-8928-fbebac67daf3 tempest-TestVolumeBootPattern-1790488751 None] Terminate volume connection completed successfully. Nov 10 04:27:52.005920 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-027fa1ee-aaca-454d-8c0d-48c6914a2bac req-b103d9ac-936f-42bb-8928-fbebac67daf3 tempest-TestVolumeBootPattern-1790488751 None] Deleting attachment 1abe53be-5927-4be7-a3b9-e650b8edb024. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:27:55.203654 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-77847f1d-d591-4fe6-a040-f6af93c00809 req-e73d7694-632f-4806-b5cb-8557a4ac74df tempest-TestVolumeBootPattern-1790488751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:27:56.242800 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-77847f1d-d591-4fe6-a040-f6af93c00809 req-e73d7694-632f-4806-b5cb-8557a4ac74df tempest-TestVolumeBootPattern-1790488751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.039s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:27:56.243664 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-77847f1d-d591-4fe6-a040-f6af93c00809 req-e73d7694-632f-4806-b5cb-8557a4ac74df tempest-TestVolumeBootPattern-1790488751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '1f0456af-a5ae-45df-97be-67c7aa662827', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:27:56.279445 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-77847f1d-d591-4fe6-a040-f6af93c00809 req-e73d7694-632f-4806-b5cb-8557a4ac74df tempest-TestVolumeBootPattern-1790488751 None] Connection info returned from driver {'name': 'volumes/volume-1f0456af-a5ae-45df-97be-67c7aa662827', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f0456af-a5ae-45df-97be-67c7aa662827', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '40cb7e79-47cf-4a84-81c4-2e661dc57d40'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:27:56.390760 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-77847f1d-d591-4fe6-a040-f6af93c00809 req-e73d7694-632f-4806-b5cb-8557a4ac74df tempest-TestVolumeBootPattern-1790488751 None] attachment_update completed successfully. Nov 10 04:28:28.565630 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:28:28.567103 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:28:28.595719 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:28:28.622401 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:29:28.563991 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:29:28.565735 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:29:28.587599 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:29:28.609001 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:29:51.145063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-3eb13152-7324-4892-9655-b7379c265bc1 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:29:51.925712 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-3eb13152-7324-4892-9655-b7379c265bc1 tempest-TestVolumeBootPattern-1790488751 None] Create snapshot completed successfully Nov 10 04:29:52.605444 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:29:52.609368 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:29:52.610174 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:29:52.631844 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (7aaa3747-cd86-40bf-a5ff-c53d9babdc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:29:52.635371 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef5a90b-71ec-4277-a89e-c23b57b295a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:29:52.641645 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:29:52.653948 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef5a90b-71ec-4277-a89e-c23b57b295a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1850208551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be6c4098d8d4e41954d19a88075cd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c78d64c8-9d42-4b4f-b5f7-e36486f786b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:29:53Z,use_quota=True,user_id='0ab02363def54c2baaf0c83f5377e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:29:52.656436 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcd9139-c4dd-42d9-be4a-95c0dde1ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:29:52.658545 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcd9139-c4dd-42d9-be4a-95c0dde1ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:29:52.660888 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4383635-3b36-425d-84c7-536ef08424bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:29:52.663598 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4383635-3b36-425d-84c7-536ef08424bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'volume_name': 'volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'volume_size': 1, 'snapshot_id': 'c78d64c8-9d42-4b4f-b5f7-e36486f786b5'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:29:52.665864 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e32263d-42ce-44c6-8482-112b4e5f59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:29:52.667971 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e32263d-42ce-44c6-8482-112b4e5f59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:29:52.670132 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0881947c-81b4-4851-b01a-e6f1d0dd8692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:29:52.670908 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Volume 7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'volume_size': 1, 'snapshot_id': 'c78d64c8-9d42-4b4f-b5f7-e36486f786b5'} Nov 10 04:29:52.691714 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] cloning volumes/volume-1f0456af-a5ae-45df-97be-67c7aa662827@snapshot-c78d64c8-9d42-4b4f-b5f7-e36486f786b5 to volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2 {{(pid=127842) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 10 04:29:52.692662 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:29:52.757395 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:29:52.894705 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:29:52.895084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:29:52.915960 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Marking volume 7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 04:29:52.920518 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Copying metadata from snapshot c78d64c8-9d42-4b4f-b5f7-e36486f786b5 to 7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 10 04:29:52.951454 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0881947c-81b4-4851-b01a-e6f1d0dd8692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'volume_size': 1, 'snapshot_id': 'c78d64c8-9d42-4b4f-b5f7-e36486f786b5'}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:29:52.953614 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909c62cd-0c3a-48fa-a6bf-4e17d0938567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:29:52.962555 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Volume volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2 (7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2): created successfully Nov 10 04:29:52.964497 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909c62cd-0c3a-48fa-a6bf-4e17d0938567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:29:52.967508 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Flow 'volume_create_manager' (7aaa3747-cd86-40bf-a5ff-c53d9babdc29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:29:52.981312 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-5cab5395-2da9-43f0-be9c-0cd1cd5416df tempest-TestVolumeBootPattern-1790488751 None] Created volume successfully. Nov 10 04:29:55.771671 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-150a9ae2-3bcf-4a2a-851e-f4fbc1c6ef10 req-03e5d825-f975-444b-8c6d-7898c497a0b2 tempest-TestVolumeBootPattern-1790488751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:29:56.562138 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-150a9ae2-3bcf-4a2a-851e-f4fbc1c6ef10 req-03e5d825-f975-444b-8c6d-7898c497a0b2 tempest-TestVolumeBootPattern-1790488751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.790s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:29:56.563218 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-150a9ae2-3bcf-4a2a-851e-f4fbc1c6ef10 req-03e5d825-f975-444b-8c6d-7898c497a0b2 tempest-TestVolumeBootPattern-1790488751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:29:56.602540 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-150a9ae2-3bcf-4a2a-851e-f4fbc1c6ef10 req-03e5d825-f975-444b-8c6d-7898c497a0b2 tempest-TestVolumeBootPattern-1790488751 None] Connection info returned from driver {'name': 'volumes/volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '915c49a1-3282-46fc-a7a0-5db9fa21972a'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:29:56.689527 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-150a9ae2-3bcf-4a2a-851e-f4fbc1c6ef10 req-03e5d825-f975-444b-8c6d-7898c497a0b2 tempest-TestVolumeBootPattern-1790488751 None] attachment_update completed successfully. Nov 10 04:30:28.567844 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:30:28.568971 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:30:28.593868 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:30:28.617608 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:31:28.573299 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:31:28.574023 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:31:28.597706 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:31:28.618596 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:31:50.966349 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-3f573e7c-7bea-476c-969b-2151492ed778 req-d5914697-dfdf-4747-9f28-38bf37db6d8b tempest-TestVolumeBootPattern-1790488751 None] Terminate volume connection completed successfully. Nov 10 04:31:50.967115 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-3f573e7c-7bea-476c-969b-2151492ed778 req-d5914697-dfdf-4747-9f28-38bf37db6d8b tempest-TestVolumeBootPattern-1790488751 None] Deleting attachment 915c49a1-3282-46fc-a7a0-5db9fa21972a. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:31:51.633814 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:31:51.664450 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:31:51.748659 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:31:51.756531 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] deleting rbd volume volume-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:31:52.015927 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['98730d36-0d32-4f7a-b83f-42182793b1c3', 'bf97abd5-f724-426b-b3cd-9d0e525b7511', '3629a047-459d-42fd-8fa8-acbc38e567a5', 'b53bd519-5172-4db9-afca-cb24cdd9e056'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:31:52.055108 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:31:52.083681 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:31:52.108077 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:31:52.113733 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] Deleted volume successfully. Nov 10 04:31:52.126042 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-0efe82f5-9473-4f11-ac45-eff588a12538 tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-7e5bdc87-fc77-4bff-b7ee-bf3b45bb72e2-delete_volume'" released by "delete_volume" :: held 0.492s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:31:52.759821 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a93b567b-508d-4937-ae5e-bc4caa5f7feb tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-c78d64c8-9d42-4b4f-b5f7-e36486f786b5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:31:52.761570 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-a93b567b-508d-4937-ae5e-bc4caa5f7feb tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:32:22.918134 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-a93b567b-508d-4937-ae5e-bc4caa5f7feb tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['27e49bad-8532-4be5-9788-ee1f013e3ada', '61edb865-7c1d-45fe-afac-ffa01afaa40d', '7ae59002-2b0d-4c57-8a23-f5e20952079d', '63063401-a8d4-4e58-aa89-d44a6e7e1072'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:32:22.956564 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-a93b567b-508d-4937-ae5e-bc4caa5f7feb tempest-TestVolumeBootPattern-1790488751 None] Delete snapshot completed successfully. Nov 10 04:32:22.961792 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-a93b567b-508d-4937-ae5e-bc4caa5f7feb tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-c78d64c8-9d42-4b4f-b5f7-e36486f786b5-delete_snapshot'" released by "delete_snapshot" :: held 30.202s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:32:26.628183 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-6f9d2891-1f7d-4d23-b163-84b69d2b7504 req-227cd140-8f72-44c0-b257-be73dc7d5077 tempest-TestVolumeBootPattern-1790488751 None] Terminate volume connection completed successfully. Nov 10 04:32:26.628826 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-6f9d2891-1f7d-4d23-b163-84b69d2b7504 req-227cd140-8f72-44c0-b257-be73dc7d5077 tempest-TestVolumeBootPattern-1790488751 None] Deleting attachment 40cb7e79-47cf-4a84-81c4-2e661dc57d40. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:32:28.574055 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:32:28.575076 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:32:28.599506 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:32:28.626188 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:32:28.643829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-1f0456af-a5ae-45df-97be-67c7aa662827-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:32:28.675845 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:32:28.736309 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:32:28.742374 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] deleting rbd volume volume-1f0456af-a5ae-45df-97be-67c7aa662827 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:32:28.978176 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 04:32:29.009063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] deleting parent snapshot volume-1f0456af-a5ae-45df-97be-67c7aa662827.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 04:32:29.937945 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] Created reservations ['151ae5c7-5df8-4952-a143-4e075a888304', 'b4071b40-da07-412b-a69c-4ed6f4d5d32a', '70292958-b4fa-471b-872b-51b3642895e9', '07d4735c-2704-4dcf-8c0a-664c798b984d'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:32:29.976837 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:32:29.998342 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:32:30.020694 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:32:30.024713 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] Deleted volume successfully. Nov 10 04:32:30.036979 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f2763d48-9f9b-48cf-9b2a-e4de2dd038cf tempest-TestVolumeBootPattern-1790488751 None] Lock "b'cinder-1f0456af-a5ae-45df-97be-67c7aa662827-delete_volume'" released by "delete_volume" :: held 1.393s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:33:28.577324 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:33:28.577978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:33:28.599855 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:33:28.621144 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:34:28.575401 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:34:28.576055 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:34:28.597782 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:34:28.618903 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:35:28.574588 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:35:28.575238 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:35:28.597982 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:35:28.618986 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:36:28.573840 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:36:28.574557 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:36:28.596344 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:36:28.617829 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:37:28.573745 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:37:28.574446 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:37:28.595769 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:37:28.617556 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:38:28.573275 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:38:28.574548 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:38:28.595852 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:38:28.617001 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:39:28.572181 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:39:28.572914 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:39:28.594272 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:39:28.616424 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:40:28.571459 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:40:28.572164 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:40:28.593701 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:40:28.615640 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:41:28.570204 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:41:28.570911 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:41:28.592797 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:41:28.613864 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:42:28.568457 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:42:28.569125 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:42:28.591137 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:42:28.614056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:43:28.568521 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:43:28.569213 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:43:28.590150 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:43:28.612468 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:44:28.567460 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:44:28.568178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:44:28.590043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:44:28.611951 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:45:28.567562 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:45:28.568214 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:45:28.589711 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:45:28.611276 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:46:28.566312 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:46:28.567119 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:46:28.588741 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:46:28.610112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:47:28.565287 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:47:28.566043 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:47:28.619314 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:47:28.651743 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:48:28.567433 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:48:28.568121 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:48:28.589942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:48:28.611776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:49:28.566477 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:49:28.567124 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:49:28.610017 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:49:28.639867 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:50:28.565111 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:50:28.565801 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:50:28.586935 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:50:28.609247 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:51:28.564397 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:51:28.565084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:51:28.587588 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:51:28.609858 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:51:34.174689 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:51:34.178903 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:51:34.179386 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:51:34.193163 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Flow 'volume_create_manager' (19e5901a-fac9-405d-88e4-41c3d3ef36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:51:34.196587 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54ccaff-aaaa-41ce-ba73-e871cef1c770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:51:34.204667 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:51:34.217713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54ccaff-aaaa-41ce-ba73-e871cef1c770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-237579637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=5b2ff647-2410-4ee6-8cf9-7b71ac3d6119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea459cc609a4ddfb7aa6bce971b1e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:51:34Z,use_quota=True,user_id='446f631ace834e75b1d9fae5240f76b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:51:34.220178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfc462a-f501-4c60-8b6e-764bcc6ad8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:51:34.222294 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfc462a-f501-4c60-8b6e-764bcc6ad8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:51:34.225289 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70b1789-7b27-498c-b76e-fa712e9b40f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:51:34.227474 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70b1789-7b27-498c-b76e-fa712e9b40f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'volume_name': 'volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:51:34.229748 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174dbe68-159a-4670-856a-3f5cfd11034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:51:34.231843 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174dbe68-159a-4670-856a-3f5cfd11034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:51:34.234005 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a3ea5c-098d-4754-86fd-bb6db211dca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:51:34.234782 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Volume 5b2ff647-2410-4ee6-8cf9-7b71ac3d6119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'volume_size': 1} Nov 10 04:51:34.235177 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] creating volume 'volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:51:34.236149 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:51:34.283916 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:51:34.284289 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:51:34.286302 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a3ea5c-098d-4754-86fd-bb6db211dca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:51:34.289178 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee38b9d-228c-4769-9a8b-a3040e0e276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:51:34.298025 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Volume volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119 (5b2ff647-2410-4ee6-8cf9-7b71ac3d6119): created successfully Nov 10 04:51:34.299846 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee38b9d-228c-4769-9a8b-a3040e0e276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:51:34.302759 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Flow 'volume_create_manager' (19e5901a-fac9-405d-88e4-41c3d3ef36aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:51:34.310132 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-b9a93c1a-488f-40d2-b19e-81bf65336be1 tempest-ServerActionsTestJSON-1070440369 None] Created volume successfully. Nov 10 04:51:35.732522 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-04879950-4a3f-4557-a6a3-088e6633faea req-ec1bac80-ae82-4572-9232-519d966325a4 tempest-ServerActionsTestJSON-1070440369 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:51:36.360559 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-04879950-4a3f-4557-a6a3-088e6633faea req-ec1bac80-ae82-4572-9232-519d966325a4 tempest-ServerActionsTestJSON-1070440369 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.628s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:51:36.361615 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-04879950-4a3f-4557-a6a3-088e6633faea req-ec1bac80-ae82-4572-9232-519d966325a4 tempest-ServerActionsTestJSON-1070440369 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:51:36.384447 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-04879950-4a3f-4557-a6a3-088e6633faea req-ec1bac80-ae82-4572-9232-519d966325a4 tempest-ServerActionsTestJSON-1070440369 None] Connection info returned from driver {'name': 'volumes/volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd1002a55-2a6a-4be3-ac3f-5a3a48ab5a79'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:51:36.427714 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-04879950-4a3f-4557-a6a3-088e6633faea req-ec1bac80-ae82-4572-9232-519d966325a4 tempest-ServerActionsTestJSON-1070440369 None] attachment_update completed successfully. Nov 10 04:51:54.200285 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-62c426e8-83b8-486f-99b0-5c3552adb6fc tempest-ServerActionsTestJSON-1070440369 None] Terminate volume connection completed successfully. Nov 10 04:51:54.200942 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-62c426e8-83b8-486f-99b0-5c3552adb6fc tempest-ServerActionsTestJSON-1070440369 None] Deleting attachment d1002a55-2a6a-4be3-ac3f-5a3a48ab5a79. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:51:56.159024 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-10fc81d7-3e73-40e3-b120-58e3a5b86a4c tempest-ServerActionsTestJSON-1070440369 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:51:56.785474 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-10fc81d7-3e73-40e3-b120-58e3a5b86a4c tempest-ServerActionsTestJSON-1070440369 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:51:56.786336 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-10fc81d7-3e73-40e3-b120-58e3a5b86a4c tempest-ServerActionsTestJSON-1070440369 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:51:56.809056 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-10fc81d7-3e73-40e3-b120-58e3a5b86a4c tempest-ServerActionsTestJSON-1070440369 None] Connection info returned from driver {'name': 'volumes/volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6dbb3160-bf13-478c-a0bd-541f9805a812'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:51:56.855635 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-b81db896-94c1-4476-9dfb-93a4d697fe70 req-10fc81d7-3e73-40e3-b120-58e3a5b86a4c tempest-ServerActionsTestJSON-1070440369 None] attachment_update completed successfully. Nov 10 04:52:03.215282 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-eded2cc8-bb11-44e2-8799-ebe6f6c47d78 tempest-ServerActionsTestJSON-1070440369 None] Terminate volume connection completed successfully. Nov 10 04:52:03.216203 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-eded2cc8-bb11-44e2-8799-ebe6f6c47d78 tempest-ServerActionsTestJSON-1070440369 None] Deleting attachment 6dbb3160-bf13-478c-a0bd-541f9805a812. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:52:05.267788 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-88da5890-57b5-40f3-81ab-d3706cf7f30e tempest-ServerActionsTestJSON-1070440369 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:52:05.912511 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-88da5890-57b5-40f3-81ab-d3706cf7f30e tempest-ServerActionsTestJSON-1070440369 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:52:05.913973 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-88da5890-57b5-40f3-81ab-d3706cf7f30e tempest-ServerActionsTestJSON-1070440369 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:52:05.935483 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-88da5890-57b5-40f3-81ab-d3706cf7f30e tempest-ServerActionsTestJSON-1070440369 None] Connection info returned from driver {'name': 'volumes/volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5b2ff647-2410-4ee6-8cf9-7b71ac3d6119', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f8750a9d-6071-4a7c-99b4-5a7bb8a81112'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:52:05.979535 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-2ba0919a-a66a-4381-a6e8-6c866310d8eb req-88da5890-57b5-40f3-81ab-d3706cf7f30e tempest-ServerActionsTestJSON-1070440369 None] attachment_update completed successfully. Nov 10 04:52:11.791721 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-ffccf7f9-5ef0-472a-8985-db8bfeb2219e req-2839b7af-ecbb-4693-ad81-d8a164af524a tempest-ServerActionsTestJSON-1070440369 None] Terminate volume connection completed successfully. Nov 10 04:52:11.792323 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-ffccf7f9-5ef0-472a-8985-db8bfeb2219e req-2839b7af-ecbb-4693-ad81-d8a164af524a tempest-ServerActionsTestJSON-1070440369 None] Deleting attachment f8750a9d-6071-4a7c-99b4-5a7bb8a81112. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:52:13.016071 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] Lock "b'cinder-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:52:13.048699 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:52:13.085543 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:52:13.086044 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] Volume volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:52:13.091491 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] deleting rbd volume volume-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:52:13.286063 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] Created reservations ['f9ff0146-605b-4b5e-afa2-9a3f7b5189f8', '248e4a09-67d3-4bf1-82aa-fa1dec108bb8', '35fab26d-49ee-4887-ac7b-ed17944bdca0', 'c6b2b448-4ad1-4e0f-8c47-a3e9aee42452'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:52:13.326250 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:52:13.350069 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:52:13.373628 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:52:13.377885 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] Deleted volume successfully. Nov 10 04:52:13.389589 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-ccec81e9-3cca-4634-b5a9-4ec4c8b7bbd8 tempest-ServerActionsTestJSON-1070440369 None] Lock "b'cinder-5b2ff647-2410-4ee6-8cf9-7b71ac3d6119-delete_volume'" released by "delete_volume" :: held 0.374s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:52:28.564494 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:52:28.565637 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:52:28.586568 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:52:28.608303 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:53:28.563089 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:53:28.565727 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:53:28.591403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:53:28.622794 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:53:45.194652 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 04:53:45.198724 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 04:53:45.199217 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 04:53:45.211332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Flow 'volume_create_manager' (7b0fb928-f245-4439-b345-84a22cfbb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:53:45.214542 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a307e5-5d49-4739-8d12-700e3f9c9a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:53:45.222295 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 04:53:45.234790 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a307e5-5d49-4739-8d12-700e3f9c9a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T04:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-850728547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=b7a717fe-d7d4-4b0b-bc8b-dea635931596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1628fcd51131459d97e1cb64ae91fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T04:53:45Z,use_quota=True,user_id='0199eec8800e4332b3349660eac2da3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:53:45.237355 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d06508-8eb4-4157-9133-a7e5c09b69b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:53:45.239433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d06508-8eb4-4157-9133-a7e5c09b69b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:53:45.242502 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4a223a-26f9-4aa1-83d1-0c234e36e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:53:45.244713 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4a223a-26f9-4aa1-83d1-0c234e36e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'volume_name': 'volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:53:45.246949 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdc0d26-67ea-4036-88c2-6bb679772b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:53:45.249027 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdc0d26-67ea-4036-88c2-6bb679772b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:53:45.251160 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84abcdc7-e80d-4fc1-96d2-d56772cbdfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:53:45.251927 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Volume b7a717fe-d7d4-4b0b-bc8b-dea635931596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'volume_size': 1} Nov 10 04:53:45.252321 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] creating volume 'volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596' {{(pid=127842) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 10 04:53:45.253315 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:53:45.329968 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 04:53:45.330335 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 04:53:45.332421 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84abcdc7-e80d-4fc1-96d2-d56772cbdfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'volume_size': 1}' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:53:45.334667 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345d24b1-c283-43f9-bd03-23065048e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 04:53:45.343422 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Volume volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596 (b7a717fe-d7d4-4b0b-bc8b-dea635931596): created successfully Nov 10 04:53:45.345225 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345d24b1-c283-43f9-bd03-23065048e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 04:53:45.348473 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Flow 'volume_create_manager' (7b0fb928-f245-4439-b345-84a22cfbb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 04:53:45.356524 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-7b153875-a9da-4c63-87aa-95735d83019a tempest-TestMinimumBasicScenario-621540950 None] Created volume successfully. Nov 10 04:53:46.729124 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-619f7ec5-0aaa-4ef0-84d1-3fb12c606173 req-2b642a90-5c51-4782-96ad-70ef30cb28f5 tempest-TestMinimumBasicScenario-621540950 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 04:53:47.581323 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-619f7ec5-0aaa-4ef0-84d1-3fb12c606173 req-2b642a90-5c51-4782-96ad-70ef30cb28f5 tempest-TestMinimumBasicScenario-621540950 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.852s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 04:53:47.582155 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-619f7ec5-0aaa-4ef0-84d1-3fb12c606173 req-2b642a90-5c51-4782-96ad-70ef30cb28f5 tempest-TestMinimumBasicScenario-621540950 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': 'b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 04:53:47.604993 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-619f7ec5-0aaa-4ef0-84d1-3fb12c606173 req-2b642a90-5c51-4782-96ad-70ef30cb28f5 tempest-TestMinimumBasicScenario-621540950 None] Connection info returned from driver {'name': 'volumes/volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b7a717fe-d7d4-4b0b-bc8b-dea635931596', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0a2c5ff6-b363-436a-8536-bdd4bb6384e1'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 04:53:47.649425 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-619f7ec5-0aaa-4ef0-84d1-3fb12c606173 req-2b642a90-5c51-4782-96ad-70ef30cb28f5 tempest-TestMinimumBasicScenario-621540950 None] attachment_update completed successfully. Nov 10 04:54:28.564990 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:54:28.566025 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:54:28.589068 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:54:28.611403 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:55:10.030850 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-e00a4b9a-7cb8-4c38-945b-ce6a3dc39512 req-33d6f232-c5fe-4f59-9ade-e46c6b423bb6 tempest-TestMinimumBasicScenario-621540950 None] Terminate volume connection completed successfully. Nov 10 04:55:10.031596 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-e00a4b9a-7cb8-4c38-945b-ce6a3dc39512 req-33d6f232-c5fe-4f59-9ade-e46c6b423bb6 tempest-TestMinimumBasicScenario-621540950 None] Deleting attachment 0a2c5ff6-b363-436a-8536-bdd4bb6384e1. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 04:55:10.823533 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] Lock "b'cinder-b7a717fe-d7d4-4b0b-bc8b-dea635931596-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 04:55:10.856313 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:55:10.905477 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 04:55:10.905937 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] Volume volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596 is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 04:55:10.911287 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] deleting rbd volume volume-b7a717fe-d7d4-4b0b-bc8b-dea635931596 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 04:55:11.108514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] Created reservations ['fc541e13-e951-4f34-8fe3-e6f4aa19ff75', '4cd61802-2f02-4106-9d2c-78d0023ff0d3', '68c37beb-0d00-4dba-8ef9-d06cb987c993', '039d7322-388d-4c82-9446-f31d4a9ac429'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 04:55:11.146906 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:55:11.172520 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:55:11.195625 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:55:11.200771 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] Deleted volume successfully. Nov 10 04:55:11.212976 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-f501e180-7435-4cde-8cdb-9a780663dd1c tempest-TestMinimumBasicScenario-621540950 None] Lock "b'cinder-b7a717fe-d7d4-4b0b-bc8b-dea635931596-delete_volume'" released by "delete_volume" :: held 0.389s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 04:55:28.568186 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:55:28.568853 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:55:28.599632 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:55:28.630199 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:57:28.568948 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:57:28.569588 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:57:28.591655 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:57:28.613358 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:58:28.567923 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:58:28.568646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:58:28.589419 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:58:28.611978 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 04:59:28.567118 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 04:59:28.567781 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:59:28.588263 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 04:59:28.609393 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:00:28.566494 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:00:28.567214 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:00:28.588720 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:00:28.610158 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:01:28.565271 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:01:28.565923 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:01:28.587030 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:01:28.608265 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:02:28.563298 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:02:28.564003 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:02:28.585057 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:02:28.606435 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:03:28.563293 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:03:28.563955 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:03:28.585086 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:03:28.607980 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:04:28.563916 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:04:28.564658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:04:28.586176 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:04:28.607857 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:05:28.564592 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:05:28.565489 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:05:28.596297 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:05:28.630948 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:06:28.561981 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:06:28.562731 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:06:28.604366 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:06:28.630776 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:07:15.053833 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-817176-1@ceph#ceph'], 'hosts': ['ncdv-817176-1@ceph#ceph']} {{(pid=127842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 10 05:07:15.057384 ncdv-817176-1 cinder-volume[127842]: WARNING stevedore.named [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 10 05:07:15.057855 ncdv-817176-1 cinder-volume[127842]: WARNING castellan.key_manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 10 05:07:15.070360 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Flow 'volume_create_manager' (002d542f-7c5b-4d69-9288-2cf0246d0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 05:07:15.073562 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cff0f2-7a01-4c55-84de-42acfd7b314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 05:07:15.079696 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_db.sqlalchemy.engines [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 10 05:07:15.092131 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cff0f2-7a01-4c55-84de-42acfd7b314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-10T05:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1028304409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-817176-1@ceph#ceph',id=4543aa2b-c63e-4071-8f17-7f45cd0a38d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c447bf3c2843d4bd6d9124a9054dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-10T05:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-10T05:07:15Z,use_quota=True,user_id='e2c40d4e29fb49fab90f2da6f01a8e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5acb72e9-5d43-4875-ad21-a683c04fb820),volume_type_id=5acb72e9-5d43-4875-ad21-a683c04fb820)' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 05:07:15.094645 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e522fba7-43e6-4b76-b471-15b963ce9ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 05:07:15.097786 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e522fba7-43e6-4b76-b471-15b963ce9ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 05:07:15.100112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1949e845-3b7c-4b34-a013-3430ee2108d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 05:07:15.179486 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1949e845-3b7c-4b34-a013-3430ee2108d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'volume_name': 'volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 05:07:15.181860 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a513a1d3-edb6-4655-9da8-e19d4fb54de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 05:07:15.184005 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a513a1d3-edb6-4655-9da8-e19d4fb54de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 05:07:15.186229 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9355f32-136b-4369-a54b-f4b5df63abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 05:07:15.187038 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Volume 4543aa2b-c63e-4071-8f17-7f45cd0a38d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 10 05:07:15.187613 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Cloning 4543aa2b-c63e-4071-8f17-7f45cd0a38d7 from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f at location (None, None). {{(pid=127842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 10 05:07:15.196494 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 05:07:15.205992 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 5, 7, 15, 200790)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 05:07:15.206429 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 05:07:15.206830 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Found cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 10 05:07:15.211012 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Lock "b'cinder-4b27f3d4-e333-4e06-a4b0-5e41ac7d127f'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 05:07:15.211912 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Attempting to retrieve cache entry for image = 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f on host ncdv-817176-1@ceph#ceph. {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 10 05:07:15.217002 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Found image-volume cache entry: {'id': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'volume_id': '583b8721-484c-4bfe-b14f-b4e8b32b6700', 'host': 'ncdv-817176-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52), 'last_used': datetime.datetime(2021, 11, 10, 5, 7, 15, 214844)}. {{(pid=127842) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 10 05:07:15.217431 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.image.cache [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Image-volume cache entry image_update_at = 2021-11-10 03:48:52+00:00, requested image updated_at = 2021-11-10 03:48:52+00:00. {{(pid=127842) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 10 05:07:15.217801 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Creating from source image-volume 583b8721-484c-4bfe-b14f-b4e8b32b6700 {{(pid=127842) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 10 05:07:15.229580 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:07:15.291532 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] creating snapshot='volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7.clone_snap' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 10 05:07:15.432802 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] cloning 'volume-583b8721-484c-4bfe-b14f-b4e8b32b6700@volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7.clone_snap' to 'volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7' {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 10 05:07:15.569967 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Volume volume-d9503646-2c1b-46f1-9bbe-418ef20ac849.deleted is not a clone. {{(pid=127842) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 10 05:07:15.571112 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 10 05:07:15.571486 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127842) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 10 05:07:15.589886 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] clone created successfully {{(pid=127842) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 10 05:07:15.590496 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.volume_utils [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Marking volume 4543aa2b-c63e-4071-8f17-7f45cd0a38d7 as bootable. {{(pid=127842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 10 05:07:15.598983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Copying metadata from image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f to 4543aa2b-c63e-4071-8f17-7f45cd0a38d7. {{(pid=127842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 10 05:07:15.599352 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Creating volume glance metadata for volume 4543aa2b-c63e-4071-8f17-7f45cd0a38d7 backed by image 4b27f3d4-e333-4e06-a4b0-5e41ac7d127f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 10 05:07:15.643841 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9355f32-136b-4369-a54b-f4b5df63abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'volume_size': 1, 'image_id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e759a896dad443d0938f7cb7473bd222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4b27f3d4-e333-4e06-a4b0-5e41ac7d127f', 'created_at': datetime.datetime(2021, 11, 10, 3, 48, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 10, 3, 48, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b27f3d4-e333-4e06-a4b0-5e41ac7d127f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 05:07:15.646052 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d4b505-9f5c-4439-945c-467f7f4466e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 10 05:07:15.653292 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.flows.manager.create_volume [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Volume volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7 (4543aa2b-c63e-4071-8f17-7f45cd0a38d7): created successfully Nov 10 05:07:15.655058 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d4b505-9f5c-4439-945c-467f7f4466e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127842) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 10 05:07:15.657940 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Flow 'volume_create_manager' (002d542f-7c5b-4d69-9288-2cf0246d0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127842) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 10 05:07:15.665175 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [None req-9308be21-0a57-48ad-a148-899386f5529c tempest-TestShelveInstance-157442872 None] Created volume successfully. Nov 10 05:07:17.889747 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a2ba3486-5df2-4fa1-8cbc-3aceae967913 req-af294df0-fbe3-494e-873b-8fd526b08f67 tempest-TestShelveInstance-157442872 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 05:07:18.891325 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-a2ba3486-5df2-4fa1-8cbc-3aceae967913 req-af294df0-fbe3-494e-873b-8fd526b08f67 tempest-TestShelveInstance-157442872 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.001s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 05:07:18.892303 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-a2ba3486-5df2-4fa1-8cbc-3aceae967913 req-af294df0-fbe3-494e-873b-8fd526b08f67 tempest-TestShelveInstance-157442872 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 05:07:18.930526 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-a2ba3486-5df2-4fa1-8cbc-3aceae967913 req-af294df0-fbe3-494e-873b-8fd526b08f67 tempest-TestShelveInstance-157442872 None] Connection info returned from driver {'name': 'volumes/volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2be2008d-9466-49c0-b2c9-df05a8061bbb'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 05:07:18.986021 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-a2ba3486-5df2-4fa1-8cbc-3aceae967913 req-af294df0-fbe3-494e-873b-8fd526b08f67 tempest-TestShelveInstance-157442872 None] attachment_update completed successfully. Nov 10 05:07:28.568588 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:07:28.569645 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:07:28.593245 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:07:28.621514 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:08:28.568750 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:08:28.569473 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:08:28.592241 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:08:28.620481 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:09:28.566375 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:09:28.567091 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:09:28.588671 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:09:28.610316 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:09:46.845876 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-e3a8c2fc-d54a-498d-af2e-ed3bb40d06bc req-1421e9ea-14e8-4a0c-80aa-480b5c73b432 tempest-TestShelveInstance-157442872 None] Terminate volume connection completed successfully. Nov 10 05:09:46.846415 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-e3a8c2fc-d54a-498d-af2e-ed3bb40d06bc req-1421e9ea-14e8-4a0c-80aa-480b5c73b432 tempest-TestShelveInstance-157442872 None] Deleting attachment 2be2008d-9466-49c0-b2c9-df05a8061bbb. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 05:09:48.621347 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-9bf883de-a9e8-4970-aaf9-8317ef3e3011 req-e02bff77-ee25-4b01-891e-01fcce47de23 tempest-TestShelveInstance-157442872 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 10 05:09:49.248891 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_concurrency.processutils [req-9bf883de-a9e8-4970-aaf9-8317ef3e3011 req-e02bff77-ee25-4b01-891e-01fcce47de23 tempest-TestShelveInstance-157442872 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.627s {{(pid=127842) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 10 05:09:49.250074 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-9bf883de-a9e8-4970-aaf9-8317ef3e3011 req-e02bff77-ee25-4b01-891e-01fcce47de23 tempest-TestShelveInstance-157442872 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'c273726b-b05d-457f-ba23-7fd03d313f37', 'volume_id': '4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'discard': True}} {{(pid=127842) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 10 05:09:49.273290 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-9bf883de-a9e8-4970-aaf9-8317ef3e3011 req-e02bff77-ee25-4b01-891e-01fcce47de23 tempest-TestShelveInstance-157442872 None] Connection info returned from driver {'name': 'volumes/volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4543aa2b-c63e-4071-8f17-7f45cd0a38d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa6ad385-3130-43d0-ab31-ae933bf476d5'} {{(pid=127842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 10 05:09:49.320258 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-9bf883de-a9e8-4970-aaf9-8317ef3e3011 req-e02bff77-ee25-4b01-891e-01fcce47de23 tempest-TestShelveInstance-157442872 None] attachment_update completed successfully. Nov 10 05:10:28.567811 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:10:28.568940 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:10:28.598983 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:10:28.624859 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:11:20.980167 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-7f972cda-b5b1-46f3-80ea-faa080a189b0 tempest-TestShelveInstance-157442872 None] Terminate volume connection completed successfully. Nov 10 05:11:20.980859 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.manager [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-7f972cda-b5b1-46f3-80ea-faa080a189b0 tempest-TestShelveInstance-157442872 None] Deleting attachment aa6ad385-3130-43d0-ab31-ae933bf476d5. {{(pid=127842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 10 05:11:21.103122 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] Lock "b'cinder-4543aa2b-c63e-4071-8f17-7f45cd0a38d7-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 10 05:11:21.133050 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:11:21.207572 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] volume has no backup snaps {{(pid=127842) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 10 05:11:21.215030 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] deleting rbd volume volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7 {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 10 05:11:21.486324 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] volume is a clone so cleaning references {{(pid=127842) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 10 05:11:21.526900 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] deleting parent snapshot volume-4543aa2b-c63e-4071-8f17-7f45cd0a38d7.clone_snap {{(pid=127842) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 10 05:11:22.584230 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.quota [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] Created reservations ['9b6c3f03-eff7-4107-885e-b1f3da685de0', 'b9fb1c08-c3af-4a68-b961-0ef5a0ed6b81', 'ee0790ae-f97d-41d6-ae78-136b48f517a3', 'f005170f-bc3b-4c64-94b4-a8605e238dbd'] {{(pid=127842) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 10 05:11:22.629332 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:11:22.656286 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:11:22.700802 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:11:22.706756 ncdv-817176-1 cinder-volume[127842]: INFO cinder.volume.manager [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] Deleted volume successfully. Nov 10 05:11:22.725346 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.coordination [req-d8ad9c80-c4fe-4107-bd14-aa397c09f0bc req-5ccd75cf-03bd-41c8-832f-b9cb98fb9a7f tempest-TestShelveInstance-157442872 None] Lock "b'cinder-4543aa2b-c63e-4071-8f17-7f45cd0a38d7-delete_volume'" released by "delete_volume" :: held 1.622s {{(pid=127842) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 10 05:11:28.569665 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:11:28.570353 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:11:28.618755 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:11:28.647517 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:12:28.573339 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:12:28.574084 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:12:28.595732 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:12:28.618087 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:13:28.574088 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:13:28.574818 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:13:28.596083 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:13:28.617916 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:14:28.573337 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:14:28.574110 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:14:28.603863 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:14:28.625658 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:15:28.572270 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:15:28.573038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:15:28.594365 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:15:28.616847 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:16:28.572317 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:16:28.573001 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:16:28.614914 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:16:28.638212 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:17:28.573419 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:17:28.574111 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:17:28.595280 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:17:28.617939 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:18:28.574644 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:18:28.575311 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:18:28.596473 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:18:28.620443 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:19:28.576344 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:19:28.577064 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:19:28.598307 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:19:28.619380 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:20:28.574045 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:20:28.574710 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:20:28.601579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:20:28.622625 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:21:28.578531 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:21:28.579210 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:21:28.602353 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:21:28.623600 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:22:28.580349 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:22:28.581038 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:22:28.602404 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:22:28.623646 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 10 05:23:28.579769 ncdv-817176-1 cinder-volume[127842]: DEBUG oslo_service.periodic_task [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127842) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 10 05:23:28.580433 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:23:28.605579 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.volume.drivers.rbd [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127842) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 10 05:23:28.627248 ncdv-817176-1 cinder-volume[127842]: DEBUG cinder.manager [None req-0fe8698d-d880-42b7-9e21-e482b849b454 None None] Notifying Schedulers of capabilities ... {{(pid=127842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}