-- Logs begin at Sat 2022-02-12 20:01:13 UTC, end at Sat 2022-02-12 22:21:57 UTC. -- Feb 12 20:52:40.680992 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Feb 12 20:52:44.043184 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=134518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 20:52:44.043782 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=134518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 20:52:44.419115 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_db.sqlalchemy.engines [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:52:44.724226 ncdv-master-1 cinder-volume[134518]: INFO cinder.rpc [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 12 20:52:44.728361 ncdv-master-1 cinder-volume[134518]: INFO cinder.rpc [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 12 20:52:44.735717 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_db.sqlalchemy.engines [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:52:44.804126 ncdv-master-1 cinder-volume[134518]: INFO cinder.volume.manager [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Determined volume DB was empty at startup. Feb 12 20:52:44.804759 ncdv-master-1 cinder-volume[134518]: DEBUG cinder.volume.manager [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=134518) __init__ /opt/stack/cinder/cinder/volume/manager.py:282}} Feb 12 20:52:44.812730 ncdv-master-1 cinder-volume[134518]: INFO cinder.volume.manager [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 12 20:52:44.813674 ncdv-master-1 cinder-volume[134518]: WARNING stevedore.named [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 20:52:44.814131 ncdv-master-1 cinder-volume[134518]: WARNING castellan.key_manager [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 20:52:44.815252 ncdv-master-1 cinder-volume[134518]: WARNING cinder.keymgr.conf_key_mgr [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 20:52:44.833882 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_db.sqlalchemy.engines [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:52:44.838858 ncdv-master-1 cinder-volume[134518]: INFO cinder.rpc [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 12 20:52:44.843406 ncdv-master-1 cinder-volume[134518]: INFO cinder.rpc [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Automatically selected cinder-volume RPC version 3.17 as minimum service version. Feb 12 20:52:44.844111 ncdv-master-1 cinder-volume[134518]: WARNING stevedore.named [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 20:52:44.844672 ncdv-master-1 cinder-volume[134518]: WARNING castellan.key_manager [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 20:52:44.846586 ncdv-master-1 cinder-volume[134518]: INFO cinder.volume.manager [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Image-volume cache enabled for host ncdv-master-1@ceph. Feb 12 20:52:44.852404 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_db.sqlalchemy.engines [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:52:44.926021 ncdv-master-1 cinder-volume[134518]: INFO oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Starting 1 workers Feb 12 20:52:44.930887 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Started child 134690 {{(pid=134518) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 12 20:52:44.931902 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Full set of CONF: {{(pid=134518) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Feb 12 20:52:44.932275 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ******************************************************************************** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 20:52:44.932587 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] Configuration options gathered from: {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 20:52:44.932932 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 20:52:44.933585 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 20:52:44.933896 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ================================================================================ {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 20:52:44.934588 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] allow_availability_zone_fallback = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.934994 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] allow_compression_on_image_upload = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.935504 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] allowed_direct_url_schemes = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.935902 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] api_rate_limit = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.936338 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] auth_strategy = keystone {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.936773 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] az_cache_duration = 3600 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.936882 ncdv-master-1 cinder-volume[134690]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Feb 12 20:52:44.937496 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_availability_zone = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.937698 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_host = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.938084 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.938478 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_stats_polling_interval = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.938866 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backup_api_class = cinder.backup.api.API {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.939877 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.940295 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backup_name_template = backup-%s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.940701 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backup_use_same_host = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.941098 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backup_use_temp_snapshot = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.941529 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] chap_password = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.941894 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] chap_username = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.942277 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.942701 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_internal_tenant_project_id = 1b89bfd9b7634100a4d518cb7b8b66f2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.943081 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_internal_tenant_user_id = 856df892e65c41e9b2ac29de966edec5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.943453 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cloned_volume_same_az = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.943821 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cluster = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.944190 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] compression_format = gzip {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.944607 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] compute_api_class = cinder.compute.nova.API {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.945031 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] config_dir = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.945332 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.945794 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] config_source = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.946156 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.946537 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] control_exchange = openstack {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.946966 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] debug = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.947323 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] default_availability_zone = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.947662 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] default_group_type = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.948240 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.949556 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] default_volume_type = ceph {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.949556 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] driver_client_cert = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.949772 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] driver_client_cert_key = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.950177 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] driver_data_namespace = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.950465 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] driver_ssl_cert_path = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.950815 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] driver_ssl_cert_verify = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.951172 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] driver_use_ssl = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.951521 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] enable_force_upload = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.951860 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] enable_new_services = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.952205 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] enable_unsupported_driver = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.952618 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] enabled_backends = ['ceph'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.953017 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] enforce_multipath_for_image_xfer = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.953347 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] filter_function = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.959617 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_api_insecure = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.959617 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_api_servers = ['http://10.222.0.31/image'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.959617 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_api_ssl_compression = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.959617 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_ca_certificates_file = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.959617 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_catalog_info = image:glance:publicURL {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.959617 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_num_retries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] glance_request_timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] goodness_function = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] graceful_shutdown_timeout = 5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960473 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] group_api_class = cinder.group.api.API {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960473 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] host = ncdv-master-1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960473 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iet_conf = /etc/iet/ietd.conf {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960473 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_compress_on_upload = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.960863 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_conversion_address_space_limit = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.961444 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_conversion_cpu_limit = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.962153 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.962975 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_upload_use_cinder_backend = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.962975 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_upload_use_internal_tenant = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.963184 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_volume_cache_enabled = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.963791 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_volume_cache_max_count = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.964154 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] image_volume_cache_max_size_gb = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.964546 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] init_host_max_objects_retrieval = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.964904 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] instance_format = [instance: %(uuid)s] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.965285 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.965698 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iscsi_iotype = fileio {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.966089 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iscsi_secondary_ip_addresses = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.966447 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iscsi_target_flags = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.966813 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iscsi_write_cache = on {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.967173 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iser_helper = tgtadm {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.967781 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iser_ip_address = 10.222.0.31 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.968192 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iser_port = 3260 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.968508 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Starting volume driver RBDDriver (1.2.0) Feb 12 20:52:44.968613 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.968912 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_config_append = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.969301 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.969805 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_dir = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.971008 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:44.971505 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_file = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.971820 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_options = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.972189 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_rotate_interval = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.972740 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_rotate_interval_type = days {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.973125 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] log_rotation_type = none {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.973452 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.973746 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.974126 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.974533 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.975019 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.975583 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] max_age = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.976148 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] max_logfile_count = 30 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.976702 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] max_logfile_size_mb = 200 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.977291 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] max_over_subscription_ratio = 20.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.977892 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] message_reap_interval = 86400 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.978458 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] message_ttl = 2592000 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.979022 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] migration_create_volume_timeout_secs = 300 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.979564 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] monkey_patch = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.980112 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] monkey_patch_modules = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.980586 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] my_ip = 10.222.0.31 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.981121 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] no_snapshot_gb_quota = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.981697 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] num_iser_scan_tries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.982266 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] num_shell_tries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.982795 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] num_volume_device_scan_tries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.983365 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] nvmet_ns_id = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.983889 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] nvmet_port_id = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.984470 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_max_limit = 1000 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.985001 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_volume_ext_list = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.985785 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.988198 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_volume_listen = 0.0.0.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.988198 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_volume_listen_port = 8776 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.988198 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_volume_use_ssl = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.988718 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] osapi_volume_workers = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.989100 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] per_volume_size_limit = -1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.989475 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] periodic_fuzzy_delay = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.990393 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] periodic_interval = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.990995 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] public_endpoint = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.991448 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] publish_errors = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.991902 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_backup_gigabytes = 1000 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.992339 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_backups = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.992757 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_consistencygroups = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.993187 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.993638 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_gigabytes = 1000 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.994073 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_groups = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.994507 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_snapshots = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.994961 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] quota_volumes = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.995404 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] rate_limit_burst = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.995847 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] rate_limit_except_level = CRITICAL {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.996281 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] rate_limit_interval = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.996714 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] reinit_driver_count = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.997122 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] replication_device = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.997635 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] report_discard_supported = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.998118 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] report_interval = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.998925 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] reservation_clean_interval = 86400 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.999431 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] reservation_expire = 86400 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:44.999870 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] reserved_percentage = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.000321 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.000755 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.001274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] rpc_response_timeout = 120 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.002404 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] run_external_periodic_tasks = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.002869 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.003315 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] scst_target_driver = iscsi {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.003734 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] scst_target_iqn_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.004083 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_down_time = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.004674 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] snapshot_name_template = snapshot-%s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.005104 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] snapshot_same_host = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.005679 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] split_loggers = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.006198 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] state_path = /opt/stack/data/cinder {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.006631 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] storage_availability_zone = nova {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.007062 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] storage_protocol = iscsi {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.007513 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] syslog_log_facility = LOG_USER {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.007944 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] target_helper = lioadm {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.008484 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] target_ip_address = 10.222.0.31 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.008904 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] target_port = 3260 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.009336 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.009796 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] target_protocol = iscsi {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.010236 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] trace_flags = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.010915 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] transfer_api_class = cinder.transfer.api.API {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.011087 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] transport_url = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.011398 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] until_refresh = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.011819 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_chap_auth = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.012236 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_default_quota_class = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.012646 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_eventlog = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.013072 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_journal = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.013686 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_json = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.014127 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_multipath_for_image_xfer = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.014562 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_stderr = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.015014 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] use_syslog = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.015511 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] verify_glance_signatures = enabled {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.016005 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_api_class = cinder.volume.api.API {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.016334 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_backend_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.017317 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_clear = zero {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.018432 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_clear_ionice = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.022846 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_clear_size = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.022846 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.022846 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_copy_bps_limit = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.022846 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_dd_blocksize = 1M {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.022846 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.022846 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_name_template = volume-%s {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.023306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_service_inithost_offload = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.023306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volume_usage_audit_period = month {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.023306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.023306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] watch_log_file = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.023306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] zoning_mode = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:52:45.023306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.023666 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.023777 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.enforce_new_defaults = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.024440 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.enforce_scope = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.024891 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.policy_default_rule = default {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.025502 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.025987 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.policy_file = policy.yaml {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.026455 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.026875 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.027287 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.027712 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.028133 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.028632 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_concurrency.disable_process_locking = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.029086 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.029604 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.admin_password = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.030034 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.030480 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.admin_token = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.030893 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.admin_user = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.031359 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_admin_prefix = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.031798 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.032236 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_port = 35357 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.034071 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_protocol = https {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.034560 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_section = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.035004 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_type = password {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.035456 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_uri = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.035868 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.auth_version = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.036296 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.cache = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.036746 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.037157 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.037608 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.delay_auth_decision = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.038055 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.038632 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.http_connect_timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.039060 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.039475 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.identity_uri = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.039891 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.include_service_catalog = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.040447 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.insecure = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.040883 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.interface = public {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.041323 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.041783 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.042209 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.042635 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.043063 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.043486 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.044031 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.044267 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.044684 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.045169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.045726 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.region_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.046306 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.046862 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.service_token_roles_required = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.049721 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.service_type = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.051358 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.token_cache_time = 300 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.052161 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] keystone_authtoken.www_authenticate_uri = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.052760 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.backend = dogpile.cache.null {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.053220 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.backend_argument = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.056054 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.config_prefix = cache.oslo {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.056727 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.dead_timeout = 60.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.057286 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.debug_cache_backend = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.058084 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.enable_retry_client = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.058506 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.enable_socket_keepalive = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.060302 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.enabled = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.060710 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.expiration_time = 600 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.061123 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.hashclient_retry_attempts = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.061549 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.hashclient_retry_delay = 1.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.061930 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_dead_retry = 300 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.062772 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.063399 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.064534 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_pool_maxsize = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.065217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.065647 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:45.066190 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.066591 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.memcache_socket_timeout = 1.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.066978 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.proxies = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.067360 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.retry_attempts = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.067878 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.retry_delay = 0.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.068442 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.socket_keepalive_count = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.069057 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.socket_keepalive_idle = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.069466 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.socket_keepalive_interval = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.069876 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.tls_allowed_ciphers = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.070266 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.tls_cafile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.070644 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.tls_certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.071003 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.tls_enabled = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.071921 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cache.tls_keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.072400 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] coordination.backend_url = etcd3+http://10.222.0.31:2379 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.072901 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.backend = sqlalchemy {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.073223 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.connection = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.073616 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.connection_debug = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.074000 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.connection_parameters = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.074355 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.connection_recycle_time = 3600 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.074727 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.connection_trace = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.075079 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.db_inc_retry_interval = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.075434 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.db_max_retries = 20 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.076128 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.db_max_retry_interval = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.076489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.db_retry_interval = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.076856 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.max_overflow = 50 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.077214 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.max_pool_size = 5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.077640 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.max_retries = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.078163 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.mysql_enable_ndb = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.078719 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.079078 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.pool_timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.080343 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.retry_interval = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.080975 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.slave_connection = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.081427 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.sqlite_synchronous = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.085852 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] database.use_db_reconnect = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.085852 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.085852 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.085852 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.085852 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.085852 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.connection_string = messaging:// {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.enabled = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.es_doc_type = notification {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.es_scroll_size = 10000 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.es_scroll_time = 2m {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086274 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.filter_error_trace = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086673 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.hmac_keys = SECRET_KEY {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.086793 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.sentinel_service_name = mymaster {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.087314 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.socket_timeout = 0.1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.087971 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] profiler.trace_sqlalchemy = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.088706 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] privsep_osbrick.capabilities = [21] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.089089 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] privsep_osbrick.group = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.089501 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] privsep_osbrick.helper_command = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.090813 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.091655 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.092186 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] privsep_osbrick.user = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.092600 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.092971 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_sys_admin.group = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.093325 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_sys_admin.helper_command = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.093743 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.094102 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.094461 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] cinder_sys_admin.user = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.094848 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.auth_section = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.095473 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.auth_type = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.095892 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.cafile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.096740 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.097135 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.collect_timing = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.097547 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.insecure = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.097926 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.098446 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.send_service_user_token = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.098802 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.split_loggers = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.099357 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] service_user.timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.099932 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.backend_availability_zone = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.100456 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.100959 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.101701 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.chap_password = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.102396 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.chap_username = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.102973 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.103519 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.104029 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.104761 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.driver_client_cert = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.105256 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.driver_client_cert_key = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.110181 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.driver_data_namespace = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.110853 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.111397 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.111930 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.driver_use_ssl = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.112485 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.enable_deferred_deletion = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.113050 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.enable_unsupported_driver = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.113454 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.113848 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.extra_capabilities = {} {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.114231 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.filter_function = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.114584 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.goodness_function = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.115206 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.115563 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.115920 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.116276 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.116659 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.117008 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.117398 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iscsi_iotype = fileio {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.117778 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.118142 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iscsi_target_flags = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.118508 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iscsi_write_cache = on {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.118920 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iser_helper = tgtadm {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.119581 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iser_ip_address = 10.222.0.31 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.119965 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iser_port = 3260 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.120337 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.120760 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.121117 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.121505 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.num_shell_tries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.nvmet_port_id = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rados_connect_timeout = -1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rados_connection_interval = 5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rados_connection_retries = 3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.125979 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_ceph_conf = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_cluster_name = ceph {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_pool = rbd {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128217 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_secret_uuid = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128594 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128594 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.rbd_user = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128594 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.replication_connect_timeout = 5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128594 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.replication_device = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128594 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.report_discard_supported = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.128911 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.129249 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.reserved_percentage = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.129667 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.scst_target_driver = iscsi {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.130028 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.scst_target_iqn_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.130391 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.storage_protocol = iscsi {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.130757 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.131119 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.target_helper = tgtadm {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.131765 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.target_ip_address = 10.222.0.31 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.132130 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.target_port = 3260 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.132501 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.132866 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.target_protocol = iscsi {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.133219 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.trace_flags = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.133628 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.unique_fqdn_network = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.134504 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.use_chap_auth = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.134504 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.134772 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_backend_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.135323 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_clear = zero {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.135669 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_clear_ionice = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.136066 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_clear_size = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.136630 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.136995 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.137371 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.137944 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.138445 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.138845 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_reports.file_event_handler = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.139234 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.139583 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_reports.log_dir = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.139973 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.backend_availability_zone = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.140349 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.backend_host = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.140695 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.backend_native_threads_pool_size = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.141043 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.backup_use_temp_snapshot = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.141489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.chap_password = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.141800 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.chap_username = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.143099 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.chiscsi_conf = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.143513 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.deferred_deletion_delay = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.143799 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.deferred_deletion_purge_interval = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.144308 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.driver_client_cert = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.144672 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.driver_client_cert_key = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.145025 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.driver_data_namespace = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.145397 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.driver_ssl_cert_path = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.145739 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.driver_ssl_cert_verify = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.146088 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.driver_use_ssl = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.146436 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.enable_deferred_deletion = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.146784 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.enable_unsupported_driver = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.147132 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.147476 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.extra_capabilities = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.147822 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.filter_function = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.148254 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.goodness_function = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.148507 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iet_conf = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.148853 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.image_upload_use_cinder_backend = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.149200 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.image_upload_use_internal_tenant = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.149598 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.image_volume_cache_enabled = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.149950 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.image_volume_cache_max_count = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.150297 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.image_volume_cache_max_size_gb = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.151280 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iscsi_iotype = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.151280 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.151585 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iscsi_target_flags = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.151721 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iscsi_write_cache = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.152050 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iser_helper = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.152369 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iser_ip_address = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.152713 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iser_port = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.153057 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.iser_target_prefix = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.153594 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.max_over_subscription_ratio = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.154097 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.num_iser_scan_tries = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.154449 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.num_shell_tries = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.154804 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.num_volume_device_scan_tries = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.155149 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.nvmet_ns_id = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.155494 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.nvmet_port_id = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.155899 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rados_connect_timeout = -1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.156246 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rados_connection_interval = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.156588 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rados_connection_retries = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.156956 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.157301 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_cluster_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.157921 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.158242 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.158597 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_max_clone_depth = 5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.158959 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_pool = volumes {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.159331 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_secret_uuid = 64d50166-8e0e-4d99-b380-f20f9972c7e5 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.159692 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_store_chunk_size = 4 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.160048 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.rbd_user = cinder {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.160567 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.replication_connect_timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.160918 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.replication_device = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.161262 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.report_discard_supported = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.report_dynamic_total_capacity = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.reserved_percentage = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.scst_target_driver = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.scst_target_iqn_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.storage_protocol = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.suppress_requests_ssl_warnings = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.166035 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.target_helper = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.target_ip_address = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.target_port = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.target_prefix = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.target_protocol = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.trace_flags = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.unique_fqdn_network = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.167033 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.use_chap_auth = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.168169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.use_multipath_for_image_xfer = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.168169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_backend_name = ceph {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.168169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_clear = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.168169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_clear_ionice = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.168169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_clear_size = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.168169 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.169687 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_copy_bps_limit = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.169687 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_dd_blocksize = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.169687 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.169996 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ceph.volumes_dir = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.170200 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.170798 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.171194 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.171544 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.171929 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.172285 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.172667 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.173059 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.173472 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.174051 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.174811 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.175034 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.175635 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.176022 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.176377 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.176754 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.177107 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.177534 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.177887 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.178258 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.178631 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.179042 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.ssl = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.179408 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.179774 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.180136 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.180514 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_rabbit.ssl_version = {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.180841 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_notifications.driver = [] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.181220 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_notifications.retry = -1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.181671 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.182021 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] oslo_messaging_notifications.transport_url = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.182356 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.182648 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] key_manager.fixed_key = **** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.183071 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.183435 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.barbican_api_version = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.183800 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.barbican_endpoint = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.184184 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.barbican_endpoint_type = public {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.184538 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.barbican_region_name = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.184882 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.cafile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.185281 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.185676 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.collect_timing = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.186022 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.insecure = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.186361 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.186711 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.number_of_retries = 60 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.187056 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.retry_delay = 1 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.187402 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.send_service_user_token = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.187769 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.split_loggers = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.188113 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.188469 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.verify_ssl = True {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican.verify_ssl_path = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.auth_section = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.auth_type = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.cafile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.collect_timing = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.197383 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.insecure = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.split_loggers = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] barbican_service_user.timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.approle_role_id = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.approle_secret_id = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.cafile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.198571 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.certfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.collect_timing = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.insecure = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.keyfile = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.kv_mountpoint = secret {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.kv_version = 2 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.namespace = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.199545 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.root_token_id = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.200489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.split_loggers = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.200489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.ssl_ca_crt_file = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.200489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.timeout = None {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.200489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.use_ssl = False {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.200489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:52:45.200489 ncdv-master-1 cinder-volume[134518]: DEBUG oslo_service.service [None req-f7218be4-6e92-4558-8229-66be26b6ff4f None None] ******************************************************************************** {{(pid=134518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 20:52:45.201331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:45.234802 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.driver [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Driver hasn't implemented _init_vendor_properties() Feb 12 20:52:45.236937 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.driver [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:0d21d973-c3ac-4273-9bcc-58b8c7c60701:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134690) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}} Feb 12 20:52:45.248682 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:52:45.290936 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.db.sqlalchemy.api [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Building query based on filter {{(pid=134690) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Feb 12 20:52:45.310544 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=134690) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Feb 12 20:52:45.316681 ncdv-master-1 cinder-volume[134690]: INFO cinder.keymgr.migration [None req-523efc05-0467-4385-9dc3-bc122d895cd7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 12 20:52:45.323511 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:45.350586 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:45.377405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 20:52:45.403917 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Driver initialization completed successfully. Feb 12 20:52:45.420392 ncdv-master-1 cinder-volume[134690]: INFO cinder.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Initiating service 3 cleanup Feb 12 20:52:45.427182 ncdv-master-1 cinder-volume[134690]: INFO cinder.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Service 3 cleanup completed. Feb 12 20:52:45.427517 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.service [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Creating RPC server for service cinder-volume {{(pid=134690) start /opt/stack/cinder/cinder/service.py:231}} Feb 12 20:52:45.434266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.service [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=134690) start /opt/stack/cinder/cinder/service.py:237}} Feb 12 20:52:45.482170 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Feb 12 20:52:45.483432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:45.512644 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:52:45.610448 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e084b25a-adea-4fad-90b3-38d2531247f9 None None] Driver post RPC initialization completed successfully. Feb 12 20:54:04.614333 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 20:54:04.615098 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:54:04.636696 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:54:04.659868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 20:55:04.614551 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 20:55:04.615244 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:55:04.636262 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:55:04.658299 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 20:56:04.613057 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 20:56:04.613805 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:56:04.636175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:56:04.660065 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 20:57:04.615220 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 20:57:04.615952 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:57:04.636864 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:57:04.658940 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 20:58:04.613803 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 20:58:04.614516 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:58:04.636220 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:58:04.657673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 20:59:04.612111 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 20:59:04.612821 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:59:04.634660 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 20:59:04.656241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:00:04.612270 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:00:04.613097 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:00:04.634752 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:00:04.657146 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:01:04.611972 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:01:04.613663 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:01:04.643875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:01:04.674755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:02:04.611674 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:02:04.614712 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:02:04.727113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:02:04.824995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:03:04.608383 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:03:04.609146 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:03:04.684601 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:03:04.762277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:04:04.611920 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:04:04.612605 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:04:04.654387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:04:04.681687 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:04:19.392542 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:04:19.401217 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:04:19.406732 ncdv-master-1 cinder-volume[134690]: INFO cinder.rpc [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Feb 12 21:04:19.411812 ncdv-master-1 cinder-volume[134690]: INFO cinder.rpc [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Feb 12 21:04:19.414554 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:04:19.414554 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:04:19.461562 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Flow 'volume_create_manager' (2d7ce849-fe20-44a4-b3dd-264d37aac653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:04:19.468151 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04af7283-42c4-478b-9fd7-a034df04770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:04:19.478214 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:04:19.541960 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04af7283-42c4-478b-9fd7-a034df04770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-652068730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ffffeab-c309-41f1-ac60-d0dc8f4b322e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97311a1994be45a2b507aedc74f578df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:04:19Z,use_quota=True,user_id='f126f64ca5e64defb9bbcf4c6bab2fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:04:19.549543 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f44ab4-4715-47a5-b925-0f429f65b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:04:19.553790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f44ab4-4715-47a5-b925-0f429f65b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:04:19.559822 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e4bb12-7959-4809-874f-b1c49ec001f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:04:19.564810 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e4bb12-7959-4809-874f-b1c49ec001f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'volume_name': 'volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:04:19.569942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd309593-e7af-460c-b943-7ed5e430052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:04:19.575197 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd309593-e7af-460c-b943-7ed5e430052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:04:19.582217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc71611-7e0b-4baa-9ad8-1dd683143090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:04:19.583539 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Volume 3ffffeab-c309-41f1-ac60-d0dc8f4b322e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'volume_size': 1} Feb 12 21:04:19.584101 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] creating volume 'volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:04:19.586361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:04:20.451331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:04:20.451331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:04:20.453902 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc71611-7e0b-4baa-9ad8-1dd683143090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:04:20.465041 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efec9af-c703-4c09-912d-966e778c0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:04:20.564248 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Volume volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e (3ffffeab-c309-41f1-ac60-d0dc8f4b322e): created successfully Feb 12 21:04:20.568368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efec9af-c703-4c09-912d-966e778c0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:04:20.575158 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Flow 'volume_create_manager' (2d7ce849-fe20-44a4-b3dd-264d37aac653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:04:20.692221 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f3521f98-93ac-49c0-8d49-525a536519b4 tempest-LiveMigrationTest-2118604256 None] Created volume successfully. Feb 12 21:04:22.926231 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 req-b59c5956-dde7-4428-acff-1b14a71f0f8d tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:04:23.715353 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 req-b59c5956-dde7-4428-acff-1b14a71f0f8d tempest-LiveMigrationTest-2118604256 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.789s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:04:23.716709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 req-b59c5956-dde7-4428-acff-1b14a71f0f8d tempest-LiveMigrationTest-2118604256 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:04:23.861305 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 req-b59c5956-dde7-4428-acff-1b14a71f0f8d tempest-LiveMigrationTest-2118604256 None] Connection info returned from driver {'name': 'volumes/volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed560e2f-dfdd-4ce2-b71d-8d4e3e0f165b'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:04:24.065889 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 req-b59c5956-dde7-4428-acff-1b14a71f0f8d tempest-LiveMigrationTest-2118604256 None] attachment_update completed successfully. Feb 12 21:04:39.277402 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-89329bee-40c7-420f-bed0-48199bff30ff req-1bbde56e-60d3-432c-964b-2a456c0ad49c tempest-LiveMigrationTest-1966938337 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:04:40.841083 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-89329bee-40c7-420f-bed0-48199bff30ff req-1bbde56e-60d3-432c-964b-2a456c0ad49c tempest-LiveMigrationTest-1966938337 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.564s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:04:40.841918 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-89329bee-40c7-420f-bed0-48199bff30ff req-1bbde56e-60d3-432c-964b-2a456c0ad49c tempest-LiveMigrationTest-1966938337 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:04:41.049799 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-89329bee-40c7-420f-bed0-48199bff30ff req-1bbde56e-60d3-432c-964b-2a456c0ad49c tempest-LiveMigrationTest-1966938337 None] Connection info returned from driver {'name': 'volumes/volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3ffffeab-c309-41f1-ac60-d0dc8f4b322e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '540b76ce-7a97-41af-ba2f-53e341602029'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:04:41.288869 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-89329bee-40c7-420f-bed0-48199bff30ff req-1bbde56e-60d3-432c-964b-2a456c0ad49c tempest-LiveMigrationTest-1966938337 None] attachment_update completed successfully. Feb 12 21:05:00.051536 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-89329bee-40c7-420f-bed0-48199bff30ff req-1e99f806-2915-4072-be69-7294d78a9ca8 tempest-LiveMigrationTest-1966938337 None] Terminate volume connection completed successfully. Feb 12 21:05:00.052369 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-89329bee-40c7-420f-bed0-48199bff30ff req-1e99f806-2915-4072-be69-7294d78a9ca8 tempest-LiveMigrationTest-1966938337 None] Deleting attachment ed560e2f-dfdd-4ce2-b71d-8d4e3e0f165b. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:05:04.611333 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:05:04.613204 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:05:04.692326 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:05:04.759255 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:05:09.301176 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-fc718a9a-46ba-4333-8386-5386859bde5c req-6540ab5b-135f-449d-a97a-811ae24f2c5c tempest-LiveMigrationTest-2118604256 None] Terminate volume connection completed successfully. Feb 12 21:05:09.301176 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-fc718a9a-46ba-4333-8386-5386859bde5c req-6540ab5b-135f-449d-a97a-811ae24f2c5c tempest-LiveMigrationTest-2118604256 None] Deleting attachment 540b76ce-7a97-41af-ba2f-53e341602029. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:05:13.108531 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:05:13.115222 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:05:13.115833 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:05:13.175350 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Flow 'volume_create_manager' (287f1e36-f543-4fdf-9588-0a6605c49b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:05:13.188735 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd0fe5c-6b55-4f64-ad6e-22135eafde8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:13.197955 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:05:13.214674 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd0fe5c-6b55-4f64-ad6e-22135eafde8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-593244537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5b5c656-a8a4-478a-aad0-b56ab96de415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97311a1994be45a2b507aedc74f578df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:05:13Z,use_quota=True,user_id='f126f64ca5e64defb9bbcf4c6bab2fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:13.223208 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182f9129-532e-4738-8970-e6f273d18123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:13.228645 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182f9129-532e-4738-8970-e6f273d18123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:13.238510 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f62748-23e4-4fee-8a08-338f4a708e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:13.462418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f62748-23e4-4fee-8a08-338f4a708e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'volume_name': 'volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:13.469880 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db3f59e-4755-4d46-973d-f728622dded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:13.480978 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db3f59e-4755-4d46-973d-f728622dded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:13.487899 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4eb7774-9281-4af8-990b-18282f8f6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:13.489822 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume e5b5c656-a8a4-478a-aad0-b56ab96de415: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:05:13.490721 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Cloning e5b5c656-a8a4-478a-aad0-b56ab96de415 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:05:13.504606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:05:13.518047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Preparing cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Feb 12 21:05:13.519659 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:05:29.478085 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:05:29.487740 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:05:29.489832 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:05:29.515944 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Flow 'volume_create_manager' (70b7c932-ce19-4153-a563-80800220d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:05:29.522990 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29abac3-6416-4966-acc3-30658d80775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:29.532247 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:05:29.550594 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29abac3-6416-4966-acc3-30658d80775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1586686373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5cab0814-9f7c-48da-bf29-6e9e480a8e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d862cc48f14c42ba73c75e882e9c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:05:29Z,use_quota=True,user_id='10910ab3eb3c4b40af57679da421dbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:29.558504 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d492c9-857c-43a6-81d5-31a4c97b3b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:29.564689 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d492c9-857c-43a6-81d5-31a4c97b3b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:29.575253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e66f099-d0cf-48c6-aced-06b646ee9e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:29.581168 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e66f099-d0cf-48c6-aced-06b646ee9e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cab0814-9f7c-48da-bf29-6e9e480a8e78', 'volume_name': 'volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:29.587884 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085c1dda-2634-4610-967b-a1154c75f88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:29.593089 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085c1dda-2634-4610-967b-a1154c75f88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:29.599959 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3bf6cd-8666-4397-915e-5122691a6f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:29.601796 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Volume 5cab0814-9f7c-48da-bf29-6e9e480a8e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78', 'volume_size': 1} Feb 12 21:05:29.602256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] creating volume 'volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:05:29.606052 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:05:30.422120 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:05:30.422709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:05:30.427501 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3bf6cd-8666-4397-915e-5122691a6f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:30.434484 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42afcd1-baec-41b4-a3d1-0e23b912b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:30.530903 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Volume volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78 (5cab0814-9f7c-48da-bf29-6e9e480a8e78): created successfully Feb 12 21:05:30.534762 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42afcd1-baec-41b4-a3d1-0e23b912b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:30.540883 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Flow 'volume_create_manager' (70b7c932-ce19-4153-a563-80800220d98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:05:30.631387 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-174de54d-829f-476f-b3e5-ac94b987574f tempest-ServersNegativeTestJSON-1351691899 None] Created volume successfully. Feb 12 21:05:32.464477 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph, size 616.00 MB, duration 18.93 sec {{(pid=134690) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Feb 12 21:05:32.466703 ncdv-master-1 cinder-volume[134690]: INFO cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Image download 616.00 MB at 32.54 MB/s Feb 12 21:05:32.522740 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:05:32.631325 ncdv-master-1 sudo[145071]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph Feb 12 21:05:32.632121 ncdv-master-1 sudo[145071]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 12 21:05:34.447995 ncdv-master-1 sudo[145071]: pam_unix(sudo:session): session closed for user root Feb 12 21:05:34.451735 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph" returned: 0 in 1.928s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:05:34.459994 ncdv-master-1 cinder-volume[134690]: WARNING py.warnings [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 12 21:05:34.459994 ncdv-master-1 cinder-volume[134690]: debtcollector.deprecate( Feb 12 21:05:34.459994 ncdv-master-1 cinder-volume[134690]: Feb 12 21:05:34.461051 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Temporary image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 is fetched for user f126f64ca5e64defb9bbcf4c6bab2fd8. {{(pid=134690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Feb 12 21:05:34.643868 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:05:34.709114 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:05:34.717341 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:05:34.717978 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:05:34.817292 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Flow 'volume_create_manager' (3df87379-b5dc-4db8-a214-3520c2daa0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:05:34.848181 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ee9e1a-083d-402a-a240-4b846f35c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:34.857685 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:05:34.901079 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ee9e1a-083d-402a-a240-4b846f35c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1962842987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a2bafc2-de43-4f5c-ba5a-eb44751ad189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d862cc48f14c42ba73c75e882e9c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:05:34Z,use_quota=True,user_id='10910ab3eb3c4b40af57679da421dbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:34.913639 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89aad4f-efce-4a79-a276-81f19e3803ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:34.922718 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89aad4f-efce-4a79-a276-81f19e3803ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:34.930640 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09361191-1d82-4ac6-bee5-3a45cf9977d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:34.937230 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09361191-1d82-4ac6-bee5-3a45cf9977d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2bafc2-de43-4f5c-ba5a-eb44751ad189', 'volume_name': 'volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:34.943787 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638e201e-e292-43e1-b3d3-08d12e991332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:34.950602 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638e201e-e292-43e1-b3d3-08d12e991332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:34.958457 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30329785-6dd8-400f-85e3-2cb6c33c08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:34.959982 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Volume 9a2bafc2-de43-4f5c-ba5a-eb44751ad189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189', 'volume_size': 1} Feb 12 21:05:34.960811 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] creating volume 'volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:05:34.962371 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:05:34.988263 ncdv-master-1 sudo[145079]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph Feb 12 21:05:34.994046 ncdv-master-1 sudo[145079]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 12 21:05:35.814220 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:05:35.815407 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:05:35.819700 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30329785-6dd8-400f-85e3-2cb6c33c08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:35.827664 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3092d5-910c-4348-96ad-8762a8d56b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:05:36.251906 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Volume volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189 (9a2bafc2-de43-4f5c-ba5a-eb44751ad189): created successfully Feb 12 21:05:36.256760 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3092d5-910c-4348-96ad-8762a8d56b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:05:36.267242 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Flow 'volume_create_manager' (3df87379-b5dc-4db8-a214-3520c2daa0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:05:36.419751 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64229567-f844-4a92-bc25-bcacc7315cda tempest-ServersNegativeTestJSON-1351691899 None] Created volume successfully. Feb 12 21:05:36.998798 ncdv-master-1 sudo[145079]: pam_unix(sudo:session): session closed for user root Feb 12 21:05:37.050383 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph" returned: 0 in 2.358s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:05:37.050383 ncdv-master-1 cinder-volume[134690]: WARNING py.warnings [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 12 21:05:37.050383 ncdv-master-1 cinder-volume[134690]: debtcollector.deprecate( Feb 12 21:05:37.050383 ncdv-master-1 cinder-volume[134690]: Feb 12 21:05:37.050383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] creating volume 'volume-e5b5c656-a8a4-478a-aad0-b56ab96de415' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:05:37.050383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:05:37.934093 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:05:37.934093 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:05:38.263892 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Attempting download of 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 ((None, None)) to volume e5b5c656-a8a4-478a-aad0-b56ab96de415. {{(pid=134690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Feb 12 21:05:51.412662 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_bn60gk5s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:05:51.597250 ncdv-master-1 sudo[145211]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_bn60gk5s Feb 12 21:05:51.602388 ncdv-master-1 sudo[145211]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 12 21:05:52.942162 ncdv-master-1 sudo[145211]: pam_unix(sudo:session): session closed for user root Feb 12 21:05:52.944566 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_bn60gk5s" returned: 0 in 1.531s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:05:52.945906 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:05:53.050614 ncdv-master-1 sudo[145216]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph Feb 12 21:05:53.051459 ncdv-master-1 sudo[145216]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 12 21:05:54.291728 ncdv-master-1 sudo[145216]: pam_unix(sudo:session): session closed for user root Feb 12 21:05:54.293986 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph" returned: 0 in 1.348s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:05:54.295440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 was vhdx, converting to raw {{(pid=134690) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Feb 12 21:05:54.296877 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprpsehy8a {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:05:54.318617 ncdv-master-1 sudo[145222]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprpsehy8a Feb 12 21:05:54.319602 ncdv-master-1 sudo[145222]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 12 21:05:56.881580 ncdv-master-1 sudo[145222]: pam_unix(sudo:session): session closed for user root Feb 12 21:05:56.883618 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmprpsehy8a" returned: 0 in 2.586s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:05:56.884623 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:05:56.987670 ncdv-master-1 sudo[145238]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph Feb 12 21:05:56.988469 ncdv-master-1 sudo[145238]: pam_unix(sudo:session): session opened for user root by (uid=0) Feb 12 21:05:57.993950 ncdv-master-1 sudo[145238]: pam_unix(sudo:session): session closed for user root Feb 12 21:05:58.006424 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph" returned: 0 in 1.121s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:05:58.007103 ncdv-master-1 cinder-volume[134690]: WARNING py.warnings [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Feb 12 21:05:58.007103 ncdv-master-1 cinder-volume[134690]: debtcollector.deprecate( Feb 12 21:05:58.007103 ncdv-master-1 cinder-volume[134690]: Feb 12 21:05:58.007731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a11baa3-e49c-4bef-9cb0-43274e3b71c9_weqd8h7rncdv-master-1@ceph, size 700.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/conversion/tmprpsehy8a {{(pid=134690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Feb 12 21:05:58.008102 ncdv-master-1 cinder-volume[134690]: INFO cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Converted 700.00 MB image at 270.51 MB/s Feb 12 21:05:58.010214 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:05:58.582228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:05:58.588378 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:05:58.757263 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] deleting rbd volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:06:00.270202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:06:00.276149 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:06:00.276913 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:06:00.307028 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Flow 'volume_create_manager' (59bc74a0-a559-4e09-85c8-6cbb80a62c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:06:00.317287 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50583c1c-2bdd-4f08-b7c1-754e86b1ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:00.335278 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:06:00.360288 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50583c1c-2bdd-4f08-b7c1-754e86b1ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-88434752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7de8dc2a-bf78-418c-82bc-d35320770acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097ba3f98cb348929658959fd4ff31cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:06:00Z,use_quota=True,user_id='3cae3e35c281419b98224db3b8ea1f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:00.379556 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055bc81b-9101-4f03-a2b6-5defe2291e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:00.387053 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055bc81b-9101-4f03-a2b6-5defe2291e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:00.395159 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3fa39f-48d0-4ffe-ac4c-43d4c41f6dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:00.403589 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3fa39f-48d0-4ffe-ac4c-43d4c41f6dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de8dc2a-bf78-418c-82bc-d35320770acc', 'volume_name': 'volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:00.411965 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750cf72d-1d3d-4ff6-9a19-aeb95ed607b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:00.426277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750cf72d-1d3d-4ff6-9a19-aeb95ed607b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:00.454167 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca009299-b6ec-4ae2-a91c-427e9d3d72e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:00.455558 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume 7de8dc2a-bf78-418c-82bc-d35320770acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'volume_size': 1} Feb 12 21:06:00.458685 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] creating volume 'volume-7de8dc2a-bf78-418c-82bc-d35320770acc' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:06:00.461784 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:06:01.758209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:06:01.758863 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:06:01.762960 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca009299-b6ec-4ae2-a91c-427e9d3d72e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:01.767690 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daf8bda-3cb5-4530-8560-f9b6a41a4f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:01.845549 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume volume-7de8dc2a-bf78-418c-82bc-d35320770acc (7de8dc2a-bf78-418c-82bc-d35320770acc): created successfully Feb 12 21:06:01.849289 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daf8bda-3cb5-4530-8560-f9b6a41a4f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:01.867220 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Flow 'volume_create_manager' (59bc74a0-a559-4e09-85c8-6cbb80a62c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:06:01.945482 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-713e95eb-33e1-4c66-8588-c27ac4d05c18 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Created volume successfully. Feb 12 21:06:04.616670 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:06:04.618121 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:06:04.690391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:06:04.763384 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:06:05.353129 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmprpsehy8a volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:06:05.940222 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca req-3c3816bc-bfe1-463d-a6c1-d5dd5d200ea4 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:06:07.749148 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca req-3c3816bc-bfe1-463d-a6c1-d5dd5d200ea4 tempest-LiveAutoBlockMigrationV225Test-774612202 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.821s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:06:07.750927 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca req-3c3816bc-bfe1-463d-a6c1-d5dd5d200ea4 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '7de8dc2a-bf78-418c-82bc-d35320770acc', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:06:07.958156 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca req-3c3816bc-bfe1-463d-a6c1-d5dd5d200ea4 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Connection info returned from driver {'name': 'volumes/volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7de8dc2a-bf78-418c-82bc-d35320770acc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d6d164d-e1e8-495d-ab9f-648c1022e9f8'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:06:08.191837 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca req-3c3816bc-bfe1-463d-a6c1-d5dd5d200ea4 tempest-LiveAutoBlockMigrationV225Test-774612202 None] attachment_update completed successfully. Feb 12 21:06:19.013099 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-bdf156dd-6e1d-4911-9b8e-63e3d52aaa6b tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:06:20.645132 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-bdf156dd-6e1d-4911-9b8e-63e3d52aaa6b tempest-LiveAutoBlockMigrationV225Test-1189065283 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.632s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:06:20.646163 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-bdf156dd-6e1d-4911-9b8e-63e3d52aaa6b tempest-LiveAutoBlockMigrationV225Test-1189065283 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '7de8dc2a-bf78-418c-82bc-d35320770acc', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:06:20.783340 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-bdf156dd-6e1d-4911-9b8e-63e3d52aaa6b tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Connection info returned from driver {'name': 'volumes/volume-7de8dc2a-bf78-418c-82bc-d35320770acc', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7de8dc2a-bf78-418c-82bc-d35320770acc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a1008c8b-0d12-4923-a6ac-2eac5eff1d99'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:06:21.000004 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-bdf156dd-6e1d-4911-9b8e-63e3d52aaa6b tempest-LiveAutoBlockMigrationV225Test-1189065283 None] attachment_update completed successfully. Feb 12 21:06:35.370040 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-d33a1fb4-ec69-4341-bc01-765f339ec03d tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Terminate volume connection completed successfully. Feb 12 21:06:35.370710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-dc770d05-96e3-44fa-b42a-84ad0767e363 req-d33a1fb4-ec69-4341-bc01-765f339ec03d tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Deleting attachment 4d6d164d-e1e8-495d-ab9f-648c1022e9f8. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:06:43.343396 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-5624010f-2a31-4609-96de-f651b6766b0f req-781e35fa-25e9-40ed-8670-992c1a8f07fe tempest-LiveAutoBlockMigrationV225Test-774612202 None] Terminate volume connection completed successfully. Feb 12 21:06:43.344026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-5624010f-2a31-4609-96de-f651b6766b0f req-781e35fa-25e9-40ed-8670-992c1a8f07fe tempest-LiveAutoBlockMigrationV225Test-774612202 None] Deleting attachment a1008c8b-0d12-4923-a6ac-2eac5eff1d99. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:06:45.260109 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:06:45.273477 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:06:45.273477 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:06:45.323507 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Flow 'volume_create_manager' (8d817a59-3406-46ef-ba9e-a3b7a6ff871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:06:45.330878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8892806b-e76f-425e-ab78-28edfbdfeee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:45.337780 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:06:45.369982 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8892806b-e76f-425e-ab78-28edfbdfeee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-507595924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='097ba3f98cb348929658959fd4ff31cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:06:45Z,use_quota=True,user_id='3cae3e35c281419b98224db3b8ea1f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:45.377222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3110262-f612-484c-8279-df677ee75ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:45.382354 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3110262-f612-484c-8279-df677ee75ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:45.391607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745c19d6-76eb-4939-bbdc-1685639c8266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:45.497512 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745c19d6-76eb-4939-bbdc-1685639c8266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'volume_name': 'volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:45.504346 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1714198a-25a9-4cc2-a21b-8f9c75e7f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:45.517349 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1714198a-25a9-4cc2-a21b-8f9c75e7f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:06:45.523328 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d175297d-0521-4422-b04a-ca612afe2b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:06:45.524615 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume 8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:06:45.525417 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Cloning 8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:07:01.302007 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmprpsehy8a volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 55.949s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:07:01.565631 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:02.924974 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:07:02.925679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:07:02.926151 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Downloaded image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 ((None, None)) to volume e5b5c656-a8a4-478a-aad0-b56ab96de415 successfully. {{(pid=134690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} Feb 12 21:07:02.995755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Temporary image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 for user f126f64ca5e64defb9bbcf4c6bab2fd8 is deleted. {{(pid=134690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Feb 12 21:07:03.195344 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:07:03.196147 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:07:03.504288 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Created reservations ['b2464f09-b839-4d94-a534-409fa1833c7b', '68607afd-9ccb-4c32-88d9-949b185ac6d7', 'a3250a6f-d133-493a-a74f-deac60f53712', '97301a2a-6658-4051-8692-7cb7c232ec84'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:07:03.526193 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Creating image volume entry: {'shared_targets': True, 'volume_type_id': '5f5cc6c2-0a46-4618-9e8b-2833fca99c88', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'encryption_key_id': None, 'terminated_at': None, 'cluster_name': None, 'launched_at': None, 'display_description': None, 'previous_status': None, 'ec2_id': None, 'deleted': False, 'provider_geometry': None, 'host': 'ncdv-master-1@ceph#ceph', 'consistencygroup_id': None, 'replication_extended_status': None, 'multiattach': False, 'volume_admin_metadata': [], 'bootable': False, 'replication_status': None, 'replication_driver_data': None, 'project_id': '1b89bfd9b7634100a4d518cb7b8b66f2', 'deleted_at': None, 'provider_location': None, 'scheduled_at': datetime.datetime(2022, 2, 12, 21, 5, 13, tzinfo=datetime.timezone.utc), 'provider_auth': None, 'group_id': None, 'created_at': datetime.datetime(2022, 2, 12, 21, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 21, 5, 13, tzinfo=datetime.timezone.utc), 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'volume_metadata': [], 'metadata': {}, 'size': 1, 'availability_zone': 'nova', 'service_uuid': None, 'display_name': 'image-4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'provider_id': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'e5b5c656-a8a4-478a-aad0-b56ab96de415'}. {{(pid=134690) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Feb 12 21:07:03.877275 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume reschedule parameters: False retry: None {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:07:03.880866 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:07:03.881293 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:07:03.919389 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Flow 'volume_create_manager' (3c5b74f1-c166-4d58-9b20-369a9bc625aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:07:03.947190 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89934de9-b600-4cac-9028-e9354060ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:03.960475 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:07:03.985090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89934de9-b600-4cac-9028-e9354060ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='image-4a11baa3-e49c-4bef-9cb0-43274e3b71c9',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4bb25651-1519-432c-86fd-b2ea70a1a658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b89bfd9b7634100a4d518cb7b8b66f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e5b5c656-a8a4-478a-aad0-b56ab96de415,status='creating',terminated_at=None,updated_at=2022-02-12T21:05:13Z,use_quota=True,user_id='f126f64ca5e64defb9bbcf4c6bab2fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:04.008470 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75011c-2ec5-4452-8c9e-7a579e5212f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:04.047354 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75011c-2ec5-4452-8c9e-7a579e5212f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:04.052451 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7c2f48-e5aa-4d09-968b-101391e90d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:04.088555 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7c2f48-e5aa-4d09-968b-101391e90d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'volume_name': 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658', 'volume_size': 1, 'source_volid': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'source_volstatus': 'downloading'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:04.096700 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0259372-f804-46c4-9e0f-cbd7c4b69522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:04.114496 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0259372-f804-46c4-9e0f-cbd7c4b69522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:04.126611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69338f35-f765-41af-b4fb-348ca9f41474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:04.130024 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume 4bb25651-1519-432c-86fd-b2ea70a1a658: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658', 'volume_size': 1, 'source_volid': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'source_volstatus': 'downloading'} Feb 12 21:07:04.159134 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:04.395451 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] creating snapshot='volume-4bb25651-1519-432c-86fd-b2ea70a1a658.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:07:06.357494 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] cloning 'volume-e5b5c656-a8a4-478a-aad0-b56ab96de415@volume-4bb25651-1519-432c-86fd-b2ea70a1a658.clone_snap' to 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:07:06.358881 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:07:06.364693 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:06.515112 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:06.685385 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:07:07.606943 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:07:07.608108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:07:07.608589 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:07:08.147975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:07:08.152626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69338f35-f765-41af-b4fb-348ca9f41474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658', 'volume_size': 1, 'source_volid': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'source_volstatus': 'downloading'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:08.162974 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df772a10-3694-4eb7-b4ee-a1619e103afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:08.309581 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume volume-4bb25651-1519-432c-86fd-b2ea70a1a658 (4bb25651-1519-432c-86fd-b2ea70a1a658): created successfully Feb 12 21:07:08.313668 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df772a10-3694-4eb7-b4ee-a1619e103afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:08.319430 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Flow 'volume_create_manager' (3c5b74f1-c166-4d58-9b20-369a9bc625aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:07:08.439996 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Created volume successfully. Feb 12 21:07:08.593888 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Creating new image-volume cache entry for image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on ncdv-master-1@ceph#ceph {{(pid=134690) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Feb 12 21:07:08.670147 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] New image-volume cache entry created: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 7, 8, 596908)}. {{(pid=134690) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Feb 12 21:07:08.677377 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 115.173s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:07:08.678108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Marking volume e5b5c656-a8a4-478a-aad0-b56ab96de415 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:07:08.765946 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to e5b5c656-a8a4-478a-aad0-b56ab96de415. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:07:08.766422 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Creating volume glance metadata for volume e5b5c656-a8a4-478a-aad0-b56ab96de415 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:07:09.097318 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4eb7774-9281-4af8-990b-18282f8f6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:09.104655 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e5fde2-347b-430e-b29c-a5fad5625383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:09.210876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 23.684s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:07:09.223291 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 7, 9, 219651)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:07:09.223969 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:07:09.224536 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:07:09.250922 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:07:09.250922 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:07:09.250922 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 7, 9, 233830)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:07:09.250922 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:07:09.251627 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:07:09.251627 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:09.570869 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] creating snapshot='volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:07:11.535302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5.clone_snap' to 'volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:07:11.541250 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 (e5b5c656-a8a4-478a-aad0-b56ab96de415): created successfully Feb 12 21:07:11.547833 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e5fde2-347b-430e-b29c-a5fad5625383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:11.584189 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Flow 'volume_create_manager' (287f1e36-f543-4fdf-9588-0a6605c49b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:07:11.720088 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e0cd4569-5422-4ec8-b4b6-aa0601dccdc9 tempest-LiveMigrationTest-2118604256 None] Created volume successfully. Feb 12 21:07:11.748766 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:07:11.753045 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:07:11.753994 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:07:11.806949 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Flow 'volume_create_manager' (a078bbff-d2d5-481e-9caf-28fbd8790b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:07:11.829033 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c2bbe7-15c4-4bd5-82fe-029c8cb1031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:11.850374 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:07:11.875723 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c2bbe7-15c4-4bd5-82fe-029c8cb1031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1076572693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3c7c811-d95c-47ea-9db2-985a51feb590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a19875f98800434db2950efcf23ff3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:07:11Z,use_quota=True,user_id='a3d2b0036a1144a4a385b4c0fd4f9782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:11.882837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ea1f0-7dc6-4d14-a6a1-0c182df85754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:11.899164 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ea1f0-7dc6-4d14-a6a1-0c182df85754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:11.908364 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90a84b6-7dcc-4f24-8a1b-c269a822f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:12.098129 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90a84b6-7dcc-4f24-8a1b-c269a822f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3c7c811-d95c-47ea-9db2-985a51feb590', 'volume_name': 'volume-d3c7c811-d95c-47ea-9db2-985a51feb590', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:12.104421 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818915fa-52df-49e2-bd28-ac1f0942db8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:12.109849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818915fa-52df-49e2-bd28-ac1f0942db8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:12.116088 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd59c7c-b176-4eb9-8d13-6c3d21ba0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:12.119033 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Volume d3c7c811-d95c-47ea-9db2-985a51feb590: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3c7c811-d95c-47ea-9db2-985a51feb590', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:07:12.119033 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Cloning d3c7c811-d95c-47ea-9db2-985a51feb590 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:07:12.135998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:07:12.223689 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 7, 12, 143766)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:07:12.224346 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:07:12.224896 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:07:12.230643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.094s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:07:12.237382 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:07:12.243987 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 7, 12, 238553)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:07:12.244425 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:07:12.244813 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:07:12.283154 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:12.606635 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] creating snapshot='volume-d3c7c811-d95c-47ea-9db2-985a51feb590.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:07:14.134280 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-d3c7c811-d95c-47ea-9db2-985a51feb590.clone_snap' to 'volume-d3c7c811-d95c-47ea-9db2-985a51feb590' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:07:14.199901 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:07:14.206962 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:07:14.218261 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:07:15.456272 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:07:15.456942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Marking volume 8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:07:15.560702 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:07:15.561508 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Creating volume glance metadata for volume 8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:07:15.771692 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-f9a17da7-87ef-47a2-a852-b512c002ccba req-903b7b8d-1cdc-4899-b13b-8babdb0b33ac tempest-LiveMigrationTest-2118604256 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:07:15.815368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d175297d-0521-4422-b04a-ca612afe2b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:15.827285 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c629a3ab-b849-4f2d-a869-dcc7743b73ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:15.938340 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5 (8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5): created successfully Feb 12 21:07:15.944283 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c629a3ab-b849-4f2d-a869-dcc7743b73ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:15.960779 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Flow 'volume_create_manager' (8d817a59-3406-46ef-ba9e-a3b7a6ff871b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:07:16.075973 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-15b48f3a-b6b9-4a98-ade5-43de4f73d3b0 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Created volume successfully. Feb 12 21:07:16.370069 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:07:16.377643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:07:16.377643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:07:16.478175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:07:16.481097 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Marking volume d3c7c811-d95c-47ea-9db2-985a51feb590 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:07:16.579222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to d3c7c811-d95c-47ea-9db2-985a51feb590. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:07:16.579657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Creating volume glance metadata for volume d3c7c811-d95c-47ea-9db2-985a51feb590 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:07:16.740702 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd59c7c-b176-4eb9-8d13-6c3d21ba0b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c7c811-d95c-47ea-9db2-985a51feb590', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:16.749545 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726d10bb-c7d8-4e0f-bdeb-8a77fbde5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:07:16.852540 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Volume volume-d3c7c811-d95c-47ea-9db2-985a51feb590 (d3c7c811-d95c-47ea-9db2-985a51feb590): created successfully Feb 12 21:07:16.857868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726d10bb-c7d8-4e0f-bdeb-8a77fbde5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:07:16.873440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Flow 'volume_create_manager' (a078bbff-d2d5-481e-9caf-28fbd8790b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:07:16.978092 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-07529ade-93fc-4389-8a6b-e2354cc86e67 tempest-ServersTestBootFromVolume-814782321 None] Created volume successfully. Feb 12 21:07:17.167039 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-f9a17da7-87ef-47a2-a852-b512c002ccba req-903b7b8d-1cdc-4899-b13b-8babdb0b33ac tempest-LiveMigrationTest-2118604256 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.395s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:07:17.168427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-f9a17da7-87ef-47a2-a852-b512c002ccba req-903b7b8d-1cdc-4899-b13b-8babdb0b33ac tempest-LiveMigrationTest-2118604256 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:07:17.281592 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-f9a17da7-87ef-47a2-a852-b512c002ccba req-903b7b8d-1cdc-4899-b13b-8babdb0b33ac tempest-LiveMigrationTest-2118604256 None] Connection info returned from driver {'name': 'volumes/volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4bdc695c-1ed6-417d-ab46-713b51c5aeb5'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:07:17.434823 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-f9a17da7-87ef-47a2-a852-b512c002ccba req-903b7b8d-1cdc-4899-b13b-8babdb0b33ac tempest-LiveMigrationTest-2118604256 None] attachment_update completed successfully. Feb 12 21:07:21.735336 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 req-9fc25519-c80b-4564-a602-4892f89a85fc tempest-LiveAutoBlockMigrationV225Test-774612202 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:07:22.457754 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 req-9fc25519-c80b-4564-a602-4892f89a85fc tempest-LiveAutoBlockMigrationV225Test-774612202 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.722s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:07:22.459027 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 req-9fc25519-c80b-4564-a602-4892f89a85fc tempest-LiveAutoBlockMigrationV225Test-774612202 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:07:22.538682 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 req-9fc25519-c80b-4564-a602-4892f89a85fc tempest-LiveAutoBlockMigrationV225Test-774612202 None] Connection info returned from driver {'name': 'volumes/volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '01296e29-5ade-4db6-83c7-d4a8372ef778'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:07:22.666378 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 req-9fc25519-c80b-4564-a602-4892f89a85fc tempest-LiveAutoBlockMigrationV225Test-774612202 None] attachment_update completed successfully. Feb 12 21:07:23.619815 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7bf43b71-9f28-4153-b493-bbf3b45df015 req-8160c631-5f69-4f5b-a6c0-c77a140c67c4 tempest-ServersTestBootFromVolume-814782321 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:07:24.355877 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7bf43b71-9f28-4153-b493-bbf3b45df015 req-8160c631-5f69-4f5b-a6c0-c77a140c67c4 tempest-ServersTestBootFromVolume-814782321 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.735s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:07:24.356683 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-7bf43b71-9f28-4153-b493-bbf3b45df015 req-8160c631-5f69-4f5b-a6c0-c77a140c67c4 tempest-ServersTestBootFromVolume-814782321 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d3c7c811-d95c-47ea-9db2-985a51feb590', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'd3c7c811-d95c-47ea-9db2-985a51feb590', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:07:24.473671 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-7bf43b71-9f28-4153-b493-bbf3b45df015 req-8160c631-5f69-4f5b-a6c0-c77a140c67c4 tempest-ServersTestBootFromVolume-814782321 None] Connection info returned from driver {'name': 'volumes/volume-d3c7c811-d95c-47ea-9db2-985a51feb590', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd3c7c811-d95c-47ea-9db2-985a51feb590', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8f3f6a00-bb7a-46c8-a79e-f39050786bda'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:07:24.626874 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-7bf43b71-9f28-4153-b493-bbf3b45df015 req-8160c631-5f69-4f5b-a6c0-c77a140c67c4 tempest-ServersTestBootFromVolume-814782321 None] attachment_update completed successfully. Feb 12 21:07:46.402623 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-cde307cb-d44f-4cef-80df-490202f68126 tempest-LiveMigrationTest-1966938337 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:07:47.534976 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-cde307cb-d44f-4cef-80df-490202f68126 tempest-LiveMigrationTest-1966938337 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.132s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:07:47.535995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-cde307cb-d44f-4cef-80df-490202f68126 tempest-LiveMigrationTest-1966938337 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:07:47.635722 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-cde307cb-d44f-4cef-80df-490202f68126 tempest-LiveMigrationTest-1966938337 None] Connection info returned from driver {'name': 'volumes/volume-e5b5c656-a8a4-478a-aad0-b56ab96de415', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e5b5c656-a8a4-478a-aad0-b56ab96de415', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0d1515e3-64a9-4af8-863c-c6b29c782753'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:07:47.790127 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-cde307cb-d44f-4cef-80df-490202f68126 tempest-LiveMigrationTest-1966938337 None] attachment_update completed successfully. Feb 12 21:07:50.013758 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-abb64359-be63-4c7c-b9ac-713f3975c16c tempest-LiveMigrationTest-1966938337 None] Terminate volume connection completed successfully. Feb 12 21:07:50.014412 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 req-abb64359-be63-4c7c-b9ac-713f3975c16c tempest-LiveMigrationTest-1966938337 None] Deleting attachment 0d1515e3-64a9-4af8-863c-c6b29c782753. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:07:52.417053 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-bd8f2336-5f90-4751-914f-db68d03468bc tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:07:53.355137 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-bd8f2336-5f90-4751-914f-db68d03468bc tempest-LiveAutoBlockMigrationV225Test-1189065283 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.937s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:07:53.359719 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-bd8f2336-5f90-4751-914f-db68d03468bc tempest-LiveAutoBlockMigrationV225Test-1189065283 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:07:53.481471 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-bd8f2336-5f90-4751-914f-db68d03468bc tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Connection info returned from driver {'name': 'volumes/volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '754f1984-1ea1-495f-a0a4-6a65ade9441f'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:07:53.705715 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-bd8f2336-5f90-4751-914f-db68d03468bc tempest-LiveAutoBlockMigrationV225Test-1189065283 None] attachment_update completed successfully. Feb 12 21:07:55.542055 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-d55e39f8-9630-41bc-a712-29747bd2c255 tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Terminate volume connection completed successfully. Feb 12 21:07:55.543366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e req-d55e39f8-9630-41bc-a712-29747bd2c255 tempest-LiveAutoBlockMigrationV225Test-1189065283 None] Deleting attachment 754f1984-1ea1-495f-a0a4-6a65ade9441f. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:07:58.343820 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-63cf86d9-d4e4-42b5-916b-643813261b07 tempest-LiveMigrationTest-2118604256 None] Terminate volume connection completed successfully. Feb 12 21:07:58.344593 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-63cf86d9-d4e4-42b5-916b-643813261b07 tempest-LiveMigrationTest-2118604256 None] Deleting attachment 4bdc695c-1ed6-417d-ab46-713b51c5aeb5. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:07:58.681158 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] Lock "b'cinder-e5b5c656-a8a4-478a-aad0-b56ab96de415-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:07:58.838154 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:07:59.063899 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:07:59.064275 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] volume has clone snapshot(s) {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Feb 12 21:07:59.066856 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:08:01.036259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] Created reservations ['e4678b98-86d5-45c2-b848-0b5e0ebb3466', '57b74ba1-6d01-43c1-9b2c-dff3810d4bcd', 'ce61bb41-b3db-4071-9289-c02df2684c01', '5ef8629c-218a-4fe6-afcb-95e86a1b12c2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:08:01.116234 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] Lock "b'cinder-3ffffeab-c309-41f1-ac60-d0dc8f4b322e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:08:01.342153 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:01.627614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:08:01.628335 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] Volume volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:08:01.760587 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] deleting rbd volume volume-3ffffeab-c309-41f1-ac60-d0dc8f4b322e {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:08:01.763343 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:01.785479 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:01.833015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:01.846634 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] Deleted volume successfully. Feb 12 21:08:01.976144 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-63fc283e-2a64-48cd-918e-4b33ab726ef0 req-a1bc553f-c9d4-4802-a744-f25cb697cd5a tempest-LiveMigrationTest-2118604256 None] Lock "b'cinder-e5b5c656-a8a4-478a-aad0-b56ab96de415-delete_volume'" released by "delete_volume" :: held 3.295s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:08:03.108246 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-efe2affd-72b5-408e-8aec-8699123f4523 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Terminate volume connection completed successfully. Feb 12 21:08:03.109601 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-efe2affd-72b5-408e-8aec-8699123f4523 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Deleting attachment 01296e29-5ade-4db6-83c7-d4a8372ef778. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:08:03.615402 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Lock "b'cinder-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:08:03.912700 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:04.385179 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:08:04.539916 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] deleting rbd volume volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:08:05.864870 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Lock "b'cinder-7de8dc2a-bf78-418c-82bc-d35320770acc-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:08:06.062304 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:06.386932 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:08:06.387457 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Volume volume-7de8dc2a-bf78-418c-82bc-d35320770acc is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:08:06.604746 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] deleting rbd volume volume-7de8dc2a-bf78-418c-82bc-d35320770acc {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:08:06.606213 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:08:06.614709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:06.671885 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:06.722071 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:08.441769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] Created reservations ['de0b8255-b090-49fb-821c-0888e3003e26', '3d6476fe-9b01-4943-8f38-0fcc94655715', '91939856-d8b2-4c8a-afc4-dbc671d78b67', '4d6ee86a-700c-4627-8b06-5be439c1a30b'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:08:08.744458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:08.820809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:08.877305 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:08.897300 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] Deleted volume successfully. Feb 12 21:08:09.028657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c286708e-c2bb-4da0-9f17-507b77e8e1dd tempest-LiveMigrationTest-2118604256 None] Lock "b'cinder-3ffffeab-c309-41f1-ac60-d0dc8f4b322e-delete_volume'" released by "delete_volume" :: held 7.909s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:08:11.572101 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] Lock "b'cinder-9a2bafc2-de43-4f5c-ba5a-eb44751ad189-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:08:11.727265 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:12.386479 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:08:12.387099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] Volume volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:08:12.858066 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] deleting rbd volume volume-9a2bafc2-de43-4f5c-ba5a-eb44751ad189 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:08:15.439500 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:08:15.975488 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] deleting parent snapshot volume-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:08:21.003075 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Created reservations ['76a7dd72-6c63-4872-ab1b-123fc5c5117a', 'c665ac7a-2363-4f3c-9094-34a8777b4592', '14498072-dcf2-453a-a8b1-efb63860e1e9', '641f69d3-c891-4ee1-a0c7-e3816764eeca'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:08:21.162839 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Created reservations ['2261cbc2-0e76-4882-ad2a-26d8e19d88e6', 'c681d14c-7f76-4538-b84e-c149ad189764', 'f2ff9f98-da51-4f84-a3cc-ec033dc49a4b', '929b624e-b669-4ed4-a186-e4a6d207ad5f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:08:21.294322 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:21.377045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:21.505546 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:21.512158 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Deleted volume successfully. Feb 12 21:08:21.596115 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8df9fd6c-8c0b-41a4-a2ff-03643bf64e14 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Lock "b'cinder-7de8dc2a-bf78-418c-82bc-d35320770acc-delete_volume'" released by "delete_volume" :: held 15.731s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:08:21.640716 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:21.709551 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:21.761786 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:21.769000 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Deleted volume successfully. Feb 12 21:08:21.886240 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-06a7f33f-f016-4a41-91c6-78115c9dcc6e req-517be593-2509-4713-9f96-eb4637042da1 tempest-LiveAutoBlockMigrationV225Test-774612202 None] Lock "b'cinder-8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5-delete_volume'" released by "delete_volume" :: held 18.271s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:08:23.221418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] Created reservations ['53f10b34-f4df-4e2e-a670-39657675dc2c', '7d9fd0ed-598e-4a9b-8eca-1ffc226d06d1', '3acccf3e-d8d6-460c-a091-a9491d002502', 'de8ea7a7-e272-4424-8175-a13b8b0f9e39'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:08:23.457622 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:23.529641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:23.614963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:23.624193 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] Deleted volume successfully. Feb 12 21:08:23.706656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e0181d05-3918-4a58-94ce-081d868abe60 tempest-ServersNegativeTestJSON-1351691899 None] Lock "b'cinder-9a2bafc2-de43-4f5c-ba5a-eb44751ad189-delete_volume'" released by "delete_volume" :: held 12.134s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:08:24.285532 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] Lock "b'cinder-5cab0814-9f7c-48da-bf29-6e9e480a8e78-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:08:24.459086 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:24.702377 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:08:24.702801 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] Volume volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:08:25.115512 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] deleting rbd volume volume-5cab0814-9f7c-48da-bf29-6e9e480a8e78 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:08:32.870104 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] Created reservations ['78141c66-568b-45d1-bc00-1fe5121fb319', '34e2def1-7495-49c7-aca9-cf41c646c8c5', '2959853c-2b47-4de1-a43c-605728a761b7', '700a3a34-f0f8-49a7-8f53-dc868d59ea89'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:08:33.306179 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:33.449299 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:33.540298 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:08:33.548596 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] Deleted volume successfully. Feb 12 21:08:33.624653 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2f71fad5-cee0-4eb2-800c-6899a12461c5 tempest-ServersNegativeTestJSON-1351691899 None] Lock "b'cinder-5cab0814-9f7c-48da-bf29-6e9e480a8e78-delete_volume'" released by "delete_volume" :: held 9.340s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:08:47.808912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:08:47.815064 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:08:47.816437 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:08:47.919513 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Flow 'volume_create_manager' (39c4b2ac-63c4-46f4-b424-3f371738073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:08:47.979751 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3040934d-eabe-46c7-a09a-3954a27ecb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:08:47.999376 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:08:48.028757 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3040934d-eabe-46c7-a09a-3954a27ecb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-181898013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c760504-b4a2-4f2f-99ea-5ede01f11a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64336eed36cb4beaaf10975e476440c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:08:47Z,use_quota=True,user_id='d4085900934546babc374620183b19fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:08:48.067837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068e2550-0e90-470a-b60d-f2603e8f00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:08:48.093693 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068e2550-0e90-470a-b60d-f2603e8f00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:08:48.126229 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef08b61-5637-4816-865c-0658e0cc89fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:08:48.142006 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef08b61-5637-4816-865c-0658e0cc89fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'volume_name': 'volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:08:48.160243 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8d8991-268a-40df-934f-487cbc602d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:08:48.173556 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8d8991-268a-40df-934f-487cbc602d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:08:48.186956 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff75ceb-2582-42ff-9781-7549035a19ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:08:48.188738 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Volume 5c760504-b4a2-4f2f-99ea-5ede01f11a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'volume_size': 1} Feb 12 21:08:48.190988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] creating volume 'volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:08:48.192347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:08:49.272678 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:08:49.273875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:08:49.278964 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff75ceb-2582-42ff-9781-7549035a19ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:08:49.289122 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2dfabc-8ec8-4c9d-8672-3813b77d7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:08:49.387878 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Volume volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08 (5c760504-b4a2-4f2f-99ea-5ede01f11a08): created successfully Feb 12 21:08:49.396091 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2dfabc-8ec8-4c9d-8672-3813b77d7b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:08:49.421434 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Flow 'volume_create_manager' (39c4b2ac-63c4-46f4-b424-3f371738073a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:08:49.548075 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-443d4415-616d-41a7-8394-1419944ce137 tempest-VolumesAdminNegativeTest-855043890 None] Created volume successfully. Feb 12 21:08:51.209049 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-3fd2c85d-3c19-47e1-872c-560267a85bb0 req-498f812f-d3a6-4ba5-9625-ba7981c2645a tempest-VolumesAdminNegativeTest-855043890 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:08:53.667958 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-3fd2c85d-3c19-47e1-872c-560267a85bb0 req-498f812f-d3a6-4ba5-9625-ba7981c2645a tempest-VolumesAdminNegativeTest-855043890 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.457s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:08:53.669706 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-3fd2c85d-3c19-47e1-872c-560267a85bb0 req-498f812f-d3a6-4ba5-9625-ba7981c2645a tempest-VolumesAdminNegativeTest-855043890 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:08:53.794037 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3fd2c85d-3c19-47e1-872c-560267a85bb0 req-498f812f-d3a6-4ba5-9625-ba7981c2645a tempest-VolumesAdminNegativeTest-855043890 None] Connection info returned from driver {'name': 'volumes/volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5c760504-b4a2-4f2f-99ea-5ede01f11a08', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0886a207-322e-464b-b156-fb8603be9d5f'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:08:54.003584 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-3fd2c85d-3c19-47e1-872c-560267a85bb0 req-498f812f-d3a6-4ba5-9625-ba7981c2645a tempest-VolumesAdminNegativeTest-855043890 None] attachment_update completed successfully. Feb 12 21:09:00.514092 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 req-f9cde9fb-2df9-4b28-b89e-09df19035bbd tempest-VolumesAdminNegativeTest-855043890 None] Terminate volume connection completed successfully. Feb 12 21:09:00.514675 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 req-f9cde9fb-2df9-4b28-b89e-09df19035bbd tempest-VolumesAdminNegativeTest-855043890 None] Deleting attachment 0886a207-322e-464b-b156-fb8603be9d5f. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:09:03.270577 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:09:03.276881 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:09:03.284423 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:09:03.312918 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Flow 'volume_create_manager' (ace59dcb-acc5-4db9-9b35-5234b00c878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:03.322332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a6fab3-35a1-4744-a5d4-1bd93ffd6ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:03.331907 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:09:03.351583 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a6fab3-35a1-4744-a5d4-1bd93ffd6ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-264138192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4dda4167-6807-4a6e-8064-9e3465a82747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64336eed36cb4beaaf10975e476440c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:09:03Z,use_quota=True,user_id='d4085900934546babc374620183b19fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:03.360828 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4112890d-2d8f-4dc7-bc58-45cb849ce8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:03.366669 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4112890d-2d8f-4dc7-bc58-45cb849ce8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:03.375113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46dbecd-b198-4cb2-9e0c-f8e31de19c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:03.382324 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46dbecd-b198-4cb2-9e0c-f8e31de19c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dda4167-6807-4a6e-8064-9e3465a82747', 'volume_name': 'volume-4dda4167-6807-4a6e-8064-9e3465a82747', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:03.390864 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed81b431-6470-4299-bcb4-018ed7a79633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:03.431022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed81b431-6470-4299-bcb4-018ed7a79633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:03.464215 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd6be7d-3a05-4246-985e-8d41ee4bae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:03.482051 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Volume 4dda4167-6807-4a6e-8064-9e3465a82747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dda4167-6807-4a6e-8064-9e3465a82747', 'volume_size': 1} Feb 12 21:09:03.484746 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] creating volume 'volume-4dda4167-6807-4a6e-8064-9e3465a82747' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:09:03.490276 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:04.697889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:09:04.699401 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:09:04.704687 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd6be7d-3a05-4246-985e-8d41ee4bae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dda4167-6807-4a6e-8064-9e3465a82747', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:04.713929 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9364c07-966c-4858-a898-8c0310268371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:04.827395 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Volume volume-4dda4167-6807-4a6e-8064-9e3465a82747 (4dda4167-6807-4a6e-8064-9e3465a82747): created successfully Feb 12 21:09:04.832790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9364c07-966c-4858-a898-8c0310268371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:04.843409 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Flow 'volume_create_manager' (ace59dcb-acc5-4db9-9b35-5234b00c878d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:04.964996 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f450cf5d-2207-4f57-9641-254e43db3d7d tempest-VolumesAdminNegativeTest-855043890 None] Created volume successfully. Feb 12 21:09:06.212071 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] Lock "b'cinder-4dda4167-6807-4a6e-8064-9e3465a82747-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:09:06.407063 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:06.770504 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:09:06.771035 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] Volume volume-4dda4167-6807-4a6e-8064-9e3465a82747 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:09:07.029299 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] deleting rbd volume volume-4dda4167-6807-4a6e-8064-9e3465a82747 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:09:07.032146 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:09:07.033473 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:07.099145 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:07.173416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:09:10.600866 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:09:10.604354 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:09:10.604860 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:09:10.656022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Flow 'volume_create_manager' (47b1e680-efb3-4cd8-91f4-13945ed70110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:10.665334 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813c728a-d95d-4717-9fd1-98271882a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:10.672420 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:09:10.695841 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813c728a-d95d-4717-9fd1-98271882a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-497119120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7c79dff3-d53d-4ae9-a438-23dc0e39df0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992939bc41444299957b35468c7433c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:09:10Z,use_quota=True,user_id='a85ec67db2e7425ba75e7a14eaf165e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:10.709345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed33a48-2283-4ad7-a0c4-5221332bebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:10.727098 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed33a48-2283-4ad7-a0c4-5221332bebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:10.732814 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3453204d-5eea-496f-8d25-d686ac6b4d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:10.906484 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3453204d-5eea-496f-8d25-d686ac6b4d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'volume_name': 'volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:10.913171 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dc3bec-500f-4009-97f4-3b56063b3743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:10.918260 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dc3bec-500f-4009-97f4-3b56063b3743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:10.924490 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea9a93-e7ca-4cfb-b091-3852a1cf0f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:10.926436 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Volume 7c79dff3-d53d-4ae9-a438-23dc0e39df0e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:09:10.927228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Cloning 7c79dff3-d53d-4ae9-a438-23dc0e39df0e from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:09:10.940690 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:09:11.050242 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 9, 10, 968406)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:09:11.054346 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:09:11.054346 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:09:11.063930 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.123s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:09:11.065188 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:09:11.076284 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 9, 11, 69179)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:09:11.077829 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:09:11.079852 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:09:11.110694 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:11.581740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] creating snapshot='volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:09:14.292999 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e.clone_snap' to 'volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:09:16.256384 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] Created reservations ['fd9aa443-caf5-4d07-a196-2e042088f262', 'b85496ba-134b-4491-b309-f9d5b5ed8824', 'a11c9945-e2de-42e7-b52b-195592db5bd7', '2ea7c102-f07a-4144-ae52-260b2117a9bd'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:09:16.577893 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:09:16.579563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:09:16.581124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:09:17.193540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:09:17.194205 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Marking volume 7c79dff3-d53d-4ae9-a438-23dc0e39df0e as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:09:17.199186 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:17.317437 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:17.405277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:09:17.414952 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] Deleted volume successfully. Feb 12 21:09:17.589271 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 7c79dff3-d53d-4ae9-a438-23dc0e39df0e. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:09:17.590156 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Creating volume glance metadata for volume 7c79dff3-d53d-4ae9-a438-23dc0e39df0e backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:09:17.596085 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8a599925-7f09-4443-a48a-dd8ced1f8795 tempest-VolumesAdminNegativeTest-855043890 None] Lock "b'cinder-4dda4167-6807-4a6e-8064-9e3465a82747-delete_volume'" released by "delete_volume" :: held 11.384s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:09:17.749581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] Lock "b'cinder-5c760504-b4a2-4f2f-99ea-5ede01f11a08-delete_volume'" acquired by "delete_volume" :: waited 0.052s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:09:17.913914 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea9a93-e7ca-4cfb-b091-3852a1cf0f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:17.915007 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1e9803-1630-4c59-ab6b-75a6e1217840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:17.994315 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:18.211001 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:09:18.211432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] Volume volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:09:18.485198 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] deleting rbd volume volume-5c760504-b4a2-4f2f-99ea-5ede01f11a08 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:09:18.489328 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Volume volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e (7c79dff3-d53d-4ae9-a438-23dc0e39df0e): created successfully Feb 12 21:09:18.495828 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1e9803-1630-4c59-ab6b-75a6e1217840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:18.508849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Flow 'volume_create_manager' (47b1e680-efb3-4cd8-91f4-13945ed70110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:18.595254 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8672e6fe-eb97-4d3d-b102-9dc4ece8f53a tempest-TaggedBootDevicesTest_v242-633755402 None] Created volume successfully. Feb 12 21:09:20.228889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:09:20.235110 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:09:20.235823 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:09:20.273568 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Flow 'volume_create_manager' (645144b6-6c76-4804-972f-2fdfeaa61eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:20.281461 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a5caf7-4000-4310-a198-c55e54d1fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:20.291277 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:09:20.308496 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a5caf7-4000-4310-a198-c55e54d1fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1207807115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e81831ca-45fb-4913-9901-1313416408ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992939bc41444299957b35468c7433c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:09:20Z,use_quota=True,user_id='a85ec67db2e7425ba75e7a14eaf165e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:20.315170 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ab7f6a-0a02-4f54-879e-998899dd6fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:20.334063 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ab7f6a-0a02-4f54-879e-998899dd6fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:20.346527 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d66ffb3-c8db-47d5-b762-1b10f1da1d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:20.354805 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d66ffb3-c8db-47d5-b762-1b10f1da1d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81831ca-45fb-4913-9901-1313416408ea', 'volume_name': 'volume-e81831ca-45fb-4913-9901-1313416408ea', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:20.361411 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1eff485-f5f5-4207-8a8e-02086affbd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:20.366364 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1eff485-f5f5-4207-8a8e-02086affbd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:20.372193 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9331be5f-a95f-4459-98b2-f3fc73a90f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:20.373644 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume e81831ca-45fb-4913-9901-1313416408ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81831ca-45fb-4913-9901-1313416408ea', 'volume_size': 1} Feb 12 21:09:20.374509 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] creating volume 'volume-e81831ca-45fb-4913-9901-1313416408ea' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:09:20.375740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:21.519301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:09:21.520341 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:09:21.524949 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9331be5f-a95f-4459-98b2-f3fc73a90f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81831ca-45fb-4913-9901-1313416408ea', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:21.535028 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae926b1e-f7b8-4c34-af0a-1d7ced01e853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:21.713343 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume volume-e81831ca-45fb-4913-9901-1313416408ea (e81831ca-45fb-4913-9901-1313416408ea): created successfully Feb 12 21:09:21.717310 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae926b1e-f7b8-4c34-af0a-1d7ced01e853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:21.722868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Flow 'volume_create_manager' (645144b6-6c76-4804-972f-2fdfeaa61eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:21.845030 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e1af1a9f-901b-405e-b195-53b40a9bdc38 tempest-TaggedBootDevicesTest_v242-633755402 None] Created volume successfully. Feb 12 21:09:23.327019 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:09:23.336979 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:09:23.342432 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:09:23.450034 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Flow 'volume_create_manager' (92b3f9b2-164e-488a-a742-d2b79fb107ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:23.518078 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d565aa-fc9f-445f-8bf8-b22a4b6b8ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:23.534893 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:09:23.607310 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d565aa-fc9f-445f-8bf8-b22a4b6b8ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-940537919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6fe52308-5497-4bfa-92db-ef7959731976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992939bc41444299957b35468c7433c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:09:23Z,use_quota=True,user_id='a85ec67db2e7425ba75e7a14eaf165e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:23.649228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3ba121-e000-4064-b721-37f230c00321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:23.670649 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3ba121-e000-4064-b721-37f230c00321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:23.702679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb72085-5498-4db6-8153-9b157da93293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:23.735562 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb72085-5498-4db6-8153-9b157da93293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe52308-5497-4bfa-92db-ef7959731976', 'volume_name': 'volume-6fe52308-5497-4bfa-92db-ef7959731976', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:23.761660 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aecc60b-324f-4b2d-967c-8a464b34c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:23.780134 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aecc60b-324f-4b2d-967c-8a464b34c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:23.795701 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdea6a8-a87e-437b-a30e-2e286582cc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:23.797149 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume 6fe52308-5497-4bfa-92db-ef7959731976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe52308-5497-4bfa-92db-ef7959731976', 'volume_size': 1} Feb 12 21:09:23.797785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] creating volume 'volume-6fe52308-5497-4bfa-92db-ef7959731976' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:09:23.800564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:24.791368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:09:24.793207 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:09:24.797458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdea6a8-a87e-437b-a30e-2e286582cc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe52308-5497-4bfa-92db-ef7959731976', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:24.813576 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bc76f4-f60d-446a-a330-ac01562ac2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:24.947383 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume volume-6fe52308-5497-4bfa-92db-ef7959731976 (6fe52308-5497-4bfa-92db-ef7959731976): created successfully Feb 12 21:09:24.947383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bc76f4-f60d-446a-a330-ac01562ac2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:24.976898 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Flow 'volume_create_manager' (92b3f9b2-164e-488a-a742-d2b79fb107ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:25.095902 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-093e6e53-324b-41b4-a35f-354e5d7e6346 tempest-TaggedBootDevicesTest_v242-633755402 None] Created volume successfully. Feb 12 21:09:26.027839 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] Created reservations ['9c3d1655-d2b0-4376-b16e-6b44a0b171e8', 'be1d5f57-fad3-4858-95af-d46b19e4b4aa', '5b9e75bf-845d-48be-bca5-9e13570bb6d5', '66fe4f13-3c20-4571-be26-7ada4df2b17f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:09:26.343690 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:26.456024 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:26.568251 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:09:26.581271 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] Deleted volume successfully. Feb 12 21:09:26.678737 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-da4d02cb-bc6d-4247-9ad0-5e8cff713e99 tempest-VolumesAdminNegativeTest-855043890 None] Lock "b'cinder-5c760504-b4a2-4f2f-99ea-5ede01f11a08-delete_volume'" released by "delete_volume" :: held 8.929s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:09:45.508360 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:09:45.523033 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:09:45.524300 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:09:45.581037 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Flow 'volume_create_manager' (3a98f3b2-a17c-4298-bb66-02b9e62dbf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:45.591415 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a134c36-46e4-4b1a-b0e7-f43aa023b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:45.601014 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:09:45.619752 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a134c36-46e4-4b1a-b0e7-f43aa023b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1631792295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2789c10f-d610-41fd-9381-586bf22c0162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e53bfabce8d42e183bcf495f606b29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:09:45Z,use_quota=True,user_id='b9de8229c9f54ad18ec20ab5f29fbcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:45.626336 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d7c205-4c2d-4a93-a10a-353d285a5b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:45.631631 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d7c205-4c2d-4a93-a10a-353d285a5b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:45.638837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835f50aa-9c06-47e9-82bf-9e27c573facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:45.645403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835f50aa-9c06-47e9-82bf-9e27c573facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2789c10f-d610-41fd-9381-586bf22c0162', 'volume_name': 'volume-2789c10f-d610-41fd-9381-586bf22c0162', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:45.652364 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2827365-15db-44f2-b012-c31fa255aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:45.657110 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2827365-15db-44f2-b012-c31fa255aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:45.663270 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eacc234d-7b73-4e44-9ada-3922ceec5376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:45.664395 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Volume 2789c10f-d610-41fd-9381-586bf22c0162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2789c10f-d610-41fd-9381-586bf22c0162', 'volume_size': 1} Feb 12 21:09:45.664950 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] creating volume 'volume-2789c10f-d610-41fd-9381-586bf22c0162' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:09:45.666209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:46.633667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:09:46.635392 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:09:46.640240 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eacc234d-7b73-4e44-9ada-3922ceec5376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2789c10f-d610-41fd-9381-586bf22c0162', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:46.646628 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ae407b-8555-4cb1-a112-a86f53dc0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:46.764443 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Volume volume-2789c10f-d610-41fd-9381-586bf22c0162 (2789c10f-d610-41fd-9381-586bf22c0162): created successfully Feb 12 21:09:46.764443 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ae407b-8555-4cb1-a112-a86f53dc0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:46.770115 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Flow 'volume_create_manager' (3a98f3b2-a17c-4298-bb66-02b9e62dbf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:46.874180 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a39427e7-d47d-4c70-9420-0c5e7cacae8d tempest-AttachSCSIVolumeTestJSON-1680990447 None] Created volume successfully. Feb 12 21:09:48.681061 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 req-5fa97a03-a421-4f2f-9213-d1f4e06d15d4 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:09:49.897854 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 req-5fa97a03-a421-4f2f-9213-d1f4e06d15d4 tempest-AttachSCSIVolumeTestJSON-1680990447 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.215s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:09:49.900113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 req-5fa97a03-a421-4f2f-9213-d1f4e06d15d4 tempest-AttachSCSIVolumeTestJSON-1680990447 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2789c10f-d610-41fd-9381-586bf22c0162', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '2789c10f-d610-41fd-9381-586bf22c0162', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:09:50.027296 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 req-5fa97a03-a421-4f2f-9213-d1f4e06d15d4 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Connection info returned from driver {'name': 'volumes/volume-2789c10f-d610-41fd-9381-586bf22c0162', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2789c10f-d610-41fd-9381-586bf22c0162', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ce24d8a4-91b2-426c-85b2-3c498a454a19'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:09:50.188685 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 req-5fa97a03-a421-4f2f-9213-d1f4e06d15d4 tempest-AttachSCSIVolumeTestJSON-1680990447 None] attachment_update completed successfully. Feb 12 21:09:54.659323 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-913c3158-c031-4e63-8b15-f32a450fd43e req-ff57820f-7d81-443d-9dcd-09485d642889 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Terminate volume connection completed successfully. Feb 12 21:09:54.659323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-913c3158-c031-4e63-8b15-f32a450fd43e req-ff57820f-7d81-443d-9dcd-09485d642889 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Deleting attachment ce24d8a4-91b2-426c-85b2-3c498a454a19. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:09:57.615322 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-23a4510b-d518-4552-b524-623bff0830c7 req-b3dd36e7-38c7-4663-92e6-84e4485d73ca tempest-TaggedBootDevicesTest_v242-633755402 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:09:58.406678 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:09:58.412451 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:09:58.414655 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:09:58.468147 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Flow 'volume_create_manager' (0b9af91b-d0d5-49ad-8e99-07bb45996572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:09:58.485854 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a4c380-f6bc-4490-a9fa-db29fac5ce1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:58.515516 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:09:58.565154 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a4c380-f6bc-4490-a9fa-db29fac5ce1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-149601862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5583872c-2e0a-476f-bbb0-bfbbf03d7db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2094e607f7bf4345beb838fc2e483911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:09:58Z,use_quota=True,user_id='d856ca6f15d74ea483e6c02dee0e0dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:58.579202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314da4ba-3229-4fbc-ae84-6bb90386fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:58.595407 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314da4ba-3229-4fbc-ae84-6bb90386fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:58.612592 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50382eb5-2837-465f-858f-0791a1206d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:58.625788 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50382eb5-2837-465f-858f-0791a1206d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'volume_name': 'volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:58.644050 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ff30e6-c1d6-4a42-95b9-76d26340cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:58.667065 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ff30e6-c1d6-4a42-95b9-76d26340cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:58.684609 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511a044c-b490-4992-bf97-cedcb2c3e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:09:58.686036 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Volume 5583872c-2e0a-476f-bbb0-bfbbf03d7db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'volume_size': 1} Feb 12 21:09:58.689069 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] creating volume 'volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:09:58.691196 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:09:59.104827 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-23a4510b-d518-4552-b524-623bff0830c7 req-b3dd36e7-38c7-4663-92e6-84e4485d73ca tempest-TaggedBootDevicesTest_v242-633755402 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.490s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:09:59.105853 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-23a4510b-d518-4552-b524-623bff0830c7 req-b3dd36e7-38c7-4663-92e6-84e4485d73ca tempest-TaggedBootDevicesTest_v242-633755402 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:09:59.233522 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-23a4510b-d518-4552-b524-623bff0830c7 req-b3dd36e7-38c7-4663-92e6-84e4485d73ca tempest-TaggedBootDevicesTest_v242-633755402 None] Connection info returned from driver {'name': 'volumes/volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7c79dff3-d53d-4ae9-a438-23dc0e39df0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f5b20040-9c6c-4514-9a1d-a1f083bb385b'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:09:59.412993 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-23a4510b-d518-4552-b524-623bff0830c7 req-b3dd36e7-38c7-4663-92e6-84e4485d73ca tempest-TaggedBootDevicesTest_v242-633755402 None] attachment_update completed successfully. Feb 12 21:09:59.909826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:09:59.910494 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:09:59.920252 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (511a044c-b490-4992-bf97-cedcb2c3e40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:09:59.934368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2362c72e-4749-41e5-ba53-700a60daf16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:00.061587 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Volume volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2 (5583872c-2e0a-476f-bbb0-bfbbf03d7db2): created successfully Feb 12 21:10:00.066792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2362c72e-4749-41e5-ba53-700a60daf16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:00.076335 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Flow 'volume_create_manager' (0b9af91b-d0d5-49ad-8e99-07bb45996572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:00.147269 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ccd7cd23-b100-4352-ac6b-2fcfac40f9be tempest-AttachVolumeShelveTestJSON-271936705 None] Created volume successfully. Feb 12 21:10:00.222314 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-23a4510b-d518-4552-b524-623bff0830c7 req-3dcb5f80-0ee6-4a15-a79e-fcbc34c1314a tempest-TaggedBootDevicesTest_v242-633755402 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:10:02.044070 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-23a4510b-d518-4552-b524-623bff0830c7 req-3dcb5f80-0ee6-4a15-a79e-fcbc34c1314a tempest-TaggedBootDevicesTest_v242-633755402 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.821s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:10:02.046790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-23a4510b-d518-4552-b524-623bff0830c7 req-3dcb5f80-0ee6-4a15-a79e-fcbc34c1314a tempest-TaggedBootDevicesTest_v242-633755402 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e81831ca-45fb-4913-9901-1313416408ea', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'e81831ca-45fb-4913-9901-1313416408ea', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:10:02.204263 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-23a4510b-d518-4552-b524-623bff0830c7 req-3dcb5f80-0ee6-4a15-a79e-fcbc34c1314a tempest-TaggedBootDevicesTest_v242-633755402 None] Connection info returned from driver {'name': 'volumes/volume-e81831ca-45fb-4913-9901-1313416408ea', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e81831ca-45fb-4913-9901-1313416408ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ff0bf8f8-3c09-4ac6-9e3a-efc1896fe2eb'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:10:02.402257 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-23a4510b-d518-4552-b524-623bff0830c7 req-3dcb5f80-0ee6-4a15-a79e-fcbc34c1314a tempest-TaggedBootDevicesTest_v242-633755402 None] attachment_update completed successfully. Feb 12 21:10:03.253961 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-23a4510b-d518-4552-b524-623bff0830c7 req-da3df128-ade3-4c13-9c6b-c3040915b05c tempest-TaggedBootDevicesTest_v242-633755402 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:10:04.346172 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-23a4510b-d518-4552-b524-623bff0830c7 req-da3df128-ade3-4c13-9c6b-c3040915b05c tempest-TaggedBootDevicesTest_v242-633755402 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.092s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:10:04.347768 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-23a4510b-d518-4552-b524-623bff0830c7 req-da3df128-ade3-4c13-9c6b-c3040915b05c tempest-TaggedBootDevicesTest_v242-633755402 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6fe52308-5497-4bfa-92db-ef7959731976', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '6fe52308-5497-4bfa-92db-ef7959731976', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:10:04.551540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-23a4510b-d518-4552-b524-623bff0830c7 req-da3df128-ade3-4c13-9c6b-c3040915b05c tempest-TaggedBootDevicesTest_v242-633755402 None] Connection info returned from driver {'name': 'volumes/volume-6fe52308-5497-4bfa-92db-ef7959731976', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6fe52308-5497-4bfa-92db-ef7959731976', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ae9a17ef-e9de-4a6e-8045-15272b450116'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:10:04.741148 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-23a4510b-d518-4552-b524-623bff0830c7 req-da3df128-ade3-4c13-9c6b-c3040915b05c tempest-TaggedBootDevicesTest_v242-633755402 None] attachment_update completed successfully. Feb 12 21:10:06.582645 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Lock "b'cinder-2789c10f-d610-41fd-9381-586bf22c0162-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:10:06.673989 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:06.912739 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:10:06.913563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Volume volume-2789c10f-d610-41fd-9381-586bf22c0162 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:10:07.153727 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] deleting rbd volume volume-2789c10f-d610-41fd-9381-586bf22c0162 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:10:07.157368 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:10:07.157368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:07.295099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:07.335263 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:10:12.914759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:10:12.921106 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:10:12.922227 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:10:12.991174 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Flow 'volume_create_manager' (adf4d3db-ae53-42de-8f88-30566bdc8228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:13.010357 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b298179-aacb-4b51-abb0-e15420c539e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:13.022822 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:10:13.049110 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b298179-aacb-4b51-abb0-e15420c539e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-437522555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff07a97663458e87406ec3a5e2cf1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:10:13Z,use_quota=True,user_id='9d5e8baa8b2d40f5ae21571ff953b9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:13.059617 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4dd424-3052-469c-848b-b4b170216bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:13.066541 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4dd424-3052-469c-848b-b4b170216bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:13.073608 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0dc4be-0a62-4869-a1a6-5226e4e3569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:13.198341 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0dc4be-0a62-4869-a1a6-5226e4e3569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'volume_name': 'volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:13.205879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96662f10-f5fb-4ebd-b86d-1df20ba49df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:13.218394 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96662f10-f5fb-4ebd-b86d-1df20ba49df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:13.225947 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9e347c-32f9-4008-a414-af41800fa588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:13.228544 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Volume 6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:10:13.230062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Cloning 6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:10:13.247963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:10:13.370314 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 10, 13, 252640)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:10:13.379820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:10:13.379820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:10:13.379820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.128s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:10:13.379820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:10:13.388258 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 10, 13, 382582)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:10:13.388866 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:10:13.392038 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:10:13.409015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:13.769714 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] creating snapshot='volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:10:18.284756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2.clone_snap' to 'volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:10:18.468323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Created reservations ['0c02993e-379a-4308-a991-6db30e0c12b0', 'd7af9d4c-469e-48d3-ace3-2738d0f099ec', '40e4ba8e-ec1c-40b4-a635-bda43ed9b389', 'fe390d1a-983e-4629-a466-07a26e0ceb1c'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:10:18.752549 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:18.820890 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:18.881346 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:10:18.886795 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Deleted volume successfully. Feb 12 21:10:18.989861 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-ae9acb67-ce9f-4d65-a76c-2eab9519db74 tempest-AttachSCSIVolumeTestJSON-1680990447 None] Lock "b'cinder-2789c10f-d610-41fd-9381-586bf22c0162-delete_volume'" released by "delete_volume" :: held 12.408s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:10:20.465861 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:10:20.467580 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:10:20.467953 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:10:21.156372 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:10:21.157101 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Marking volume 6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:10:21.263170 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:10:21.263170 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Creating volume glance metadata for volume 6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:10:21.478298 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9e347c-32f9-4008-a414-af41800fa588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:21.483875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3354e9-5209-4eac-9583-984da00c42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:21.564377 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Volume volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2 (6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2): created successfully Feb 12 21:10:21.568762 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3354e9-5209-4eac-9583-984da00c42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:21.585026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Flow 'volume_create_manager' (adf4d3db-ae53-42de-8f88-30566bdc8228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:21.673583 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-384e852c-1017-4ef7-bdc4-23886b7142d7 tempest-TaggedBootDevicesTest-172445176 None] Created volume successfully. Feb 12 21:10:23.796404 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:10:23.802756 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:10:23.803516 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:10:23.832426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Flow 'volume_create_manager' (df0372dd-b324-4e2a-b2aa-cc8add0a8596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:23.853955 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce35c094-6d4c-40b2-b345-696faf34506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:23.865807 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:10:23.890083 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce35c094-6d4c-40b2-b345-696faf34506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-625144465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff07a97663458e87406ec3a5e2cf1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:10:24Z,use_quota=True,user_id='9d5e8baa8b2d40f5ae21571ff953b9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:23.890600 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0afa62-f1df-47c7-98af-c90d7546035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:23.899710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0afa62-f1df-47c7-98af-c90d7546035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:23.920750 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5878001f-2312-45dc-836e-9fbc38667b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:23.927445 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5878001f-2312-45dc-836e-9fbc38667b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'volume_name': 'volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:23.941235 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06feacff-f7df-488c-86b6-f089d52b8e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:23.941235 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06feacff-f7df-488c-86b6-f089d52b8e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:23.954785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a99a0cc-fe8a-43cd-a572-1841c82c32af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:23.956242 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Volume d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'volume_size': 1} Feb 12 21:10:23.956898 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] creating volume 'volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:10:23.958467 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:24.816132 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:10:24.817210 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:10:24.822362 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a99a0cc-fe8a-43cd-a572-1841c82c32af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:24.829670 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81587719-91a9-4338-85d8-33688a45baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:24.935651 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Volume volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a (d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a): created successfully Feb 12 21:10:24.940541 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81587719-91a9-4338-85d8-33688a45baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:24.948099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Flow 'volume_create_manager' (df0372dd-b324-4e2a-b2aa-cc8add0a8596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:25.029334 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-83348761-0dc7-4315-8bee-d85a881780fa tempest-TaggedBootDevicesTest-172445176 None] Created volume successfully. Feb 12 21:10:27.054399 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:10:27.062218 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:10:27.068277 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:10:27.157408 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Flow 'volume_create_manager' (f3799385-5dc9-4c35-a160-71d08278a5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:27.179353 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617176fd-24a1-4781-9068-0c6b36598735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:27.209246 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:10:27.287165 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617176fd-24a1-4781-9068-0c6b36598735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1291497524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2abea7c0-bbed-4f39-8231-884740b5d70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1ff07a97663458e87406ec3a5e2cf1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:10:27Z,use_quota=True,user_id='9d5e8baa8b2d40f5ae21571ff953b9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:27.318293 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a03c71a-97bc-4fae-b629-cb7e222a8803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:27.333817 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a03c71a-97bc-4fae-b629-cb7e222a8803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:27.341522 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8007af-73ad-4934-8ab2-9bb480e0df01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:27.348000 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8007af-73ad-4934-8ab2-9bb480e0df01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abea7c0-bbed-4f39-8231-884740b5d70b', 'volume_name': 'volume-2abea7c0-bbed-4f39-8231-884740b5d70b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:27.356748 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cec489b-a61c-4c70-b3a7-930fe24d13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:27.363382 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cec489b-a61c-4c70-b3a7-930fe24d13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:27.371621 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23d82db-be4b-491e-8695-bd41d114b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:27.374337 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Volume 2abea7c0-bbed-4f39-8231-884740b5d70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abea7c0-bbed-4f39-8231-884740b5d70b', 'volume_size': 1} Feb 12 21:10:27.375011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] creating volume 'volume-2abea7c0-bbed-4f39-8231-884740b5d70b' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:10:27.376331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:10:28.635416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:10:28.636401 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:10:28.640706 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23d82db-be4b-491e-8695-bd41d114b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abea7c0-bbed-4f39-8231-884740b5d70b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:28.650079 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7e6fef-f012-4c60-b15e-1f382a074873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:10:28.701197 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Volume volume-2abea7c0-bbed-4f39-8231-884740b5d70b (2abea7c0-bbed-4f39-8231-884740b5d70b): created successfully Feb 12 21:10:28.707532 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7e6fef-f012-4c60-b15e-1f382a074873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:10:28.715548 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Flow 'volume_create_manager' (f3799385-5dc9-4c35-a160-71d08278a5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:10:28.803673 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-190c96c7-3004-4577-9d5d-9594246ae067 tempest-TaggedBootDevicesTest-172445176 None] Created volume successfully. Feb 12 21:10:55.595087 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d6324944-1733-4440-8a9d-36b92424de26 req-7e5fc328-49d5-4981-b05f-fe4bb2f995f7 tempest-TaggedBootDevicesTest-172445176 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:10:56.659822 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d6324944-1733-4440-8a9d-36b92424de26 req-7e5fc328-49d5-4981-b05f-fe4bb2f995f7 tempest-TaggedBootDevicesTest-172445176 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.064s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:10:56.660569 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-d6324944-1733-4440-8a9d-36b92424de26 req-7e5fc328-49d5-4981-b05f-fe4bb2f995f7 tempest-TaggedBootDevicesTest-172445176 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:10:56.763861 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-d6324944-1733-4440-8a9d-36b92424de26 req-7e5fc328-49d5-4981-b05f-fe4bb2f995f7 tempest-TaggedBootDevicesTest-172445176 None] Connection info returned from driver {'name': 'volumes/volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '431ce69e-95d4-4476-a6d2-de0e950a4c7f'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:10:56.991643 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-d6324944-1733-4440-8a9d-36b92424de26 req-7e5fc328-49d5-4981-b05f-fe4bb2f995f7 tempest-TaggedBootDevicesTest-172445176 None] attachment_update completed successfully. Feb 12 21:10:57.957784 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d6324944-1733-4440-8a9d-36b92424de26 req-37729ec9-0c2d-484a-9509-8e8292aa9a6e tempest-TaggedBootDevicesTest-172445176 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:10:59.258490 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d6324944-1733-4440-8a9d-36b92424de26 req-37729ec9-0c2d-484a-9509-8e8292aa9a6e tempest-TaggedBootDevicesTest-172445176 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.300s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:10:59.272095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-d6324944-1733-4440-8a9d-36b92424de26 req-37729ec9-0c2d-484a-9509-8e8292aa9a6e tempest-TaggedBootDevicesTest-172445176 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'd4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:10:59.455259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-d6324944-1733-4440-8a9d-36b92424de26 req-37729ec9-0c2d-484a-9509-8e8292aa9a6e tempest-TaggedBootDevicesTest-172445176 None] Connection info returned from driver {'name': 'volumes/volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '99969a56-838a-4667-8fd0-545b285f45ef'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:10:59.639970 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-d6324944-1733-4440-8a9d-36b92424de26 req-37729ec9-0c2d-484a-9509-8e8292aa9a6e tempest-TaggedBootDevicesTest-172445176 None] attachment_update completed successfully. Feb 12 21:11:00.576572 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d6324944-1733-4440-8a9d-36b92424de26 req-4b0d5e54-b7e7-404c-b812-4091e6bda59e tempest-TaggedBootDevicesTest-172445176 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:11:02.102391 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d6324944-1733-4440-8a9d-36b92424de26 req-4b0d5e54-b7e7-404c-b812-4091e6bda59e tempest-TaggedBootDevicesTest-172445176 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.526s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:11:02.103117 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-d6324944-1733-4440-8a9d-36b92424de26 req-4b0d5e54-b7e7-404c-b812-4091e6bda59e tempest-TaggedBootDevicesTest-172445176 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2abea7c0-bbed-4f39-8231-884740b5d70b', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '2abea7c0-bbed-4f39-8231-884740b5d70b', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:11:02.266665 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-d6324944-1733-4440-8a9d-36b92424de26 req-4b0d5e54-b7e7-404c-b812-4091e6bda59e tempest-TaggedBootDevicesTest-172445176 None] Connection info returned from driver {'name': 'volumes/volume-2abea7c0-bbed-4f39-8231-884740b5d70b', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2abea7c0-bbed-4f39-8231-884740b5d70b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '940ca346-e9ef-4cc8-bab0-665c0b73f46d'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:11:02.508461 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-d6324944-1733-4440-8a9d-36b92424de26 req-4b0d5e54-b7e7-404c-b812-4091e6bda59e tempest-TaggedBootDevicesTest-172445176 None] attachment_update completed successfully. Feb 12 21:11:07.153110 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:11:07.154542 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:11:07.249910 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:11:07.336033 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:11:20.786680 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b req-d9a97cc4-24ad-4d99-935e-be7e9edb92e2 tempest-AttachVolumeShelveTestJSON-271936705 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:11:22.032447 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b req-d9a97cc4-24ad-4d99-935e-be7e9edb92e2 tempest-AttachVolumeShelveTestJSON-271936705 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.239s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:11:22.033924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b req-d9a97cc4-24ad-4d99-935e-be7e9edb92e2 tempest-AttachVolumeShelveTestJSON-271936705 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:11:22.216709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b req-d9a97cc4-24ad-4d99-935e-be7e9edb92e2 tempest-AttachVolumeShelveTestJSON-271936705 None] Connection info returned from driver {'name': 'volumes/volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5583872c-2e0a-476f-bbb0-bfbbf03d7db2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e5db5c2b-0f8e-4a9e-b9f3-e5d3fe487668'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:11:22.434350 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b req-d9a97cc4-24ad-4d99-935e-be7e9edb92e2 tempest-AttachVolumeShelveTestJSON-271936705 None] attachment_update completed successfully. Feb 12 21:12:07.155356 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:12:07.156223 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:12:07.219302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:12:07.272870 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:12:31.027852 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-f44b640d-64ce-4959-878f-18dab3888a89 req-f0074049-7a0a-4044-8e0c-e7ed719b050d tempest-AttachVolumeShelveTestJSON-271936705 None] Terminate volume connection completed successfully. Feb 12 21:12:31.029536 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-f44b640d-64ce-4959-878f-18dab3888a89 req-f0074049-7a0a-4044-8e0c-e7ed719b050d tempest-AttachVolumeShelveTestJSON-271936705 None] Deleting attachment e5db5c2b-0f8e-4a9e-b9f3-e5d3fe487668. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:13:05.717006 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:13:05.723641 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:13:05.723641 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:13:05.741867 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Flow 'volume_create_manager' (d7351c23-e8e4-4a86-acf2-53a5fbb10204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:13:05.749636 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b89c284-aae1-4d37-ae81-6ae6bcddb67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:05.756703 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:13:05.773410 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b89c284-aae1-4d37-ae81-6ae6bcddb67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-523653072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6e215f7-2439-4ab4-8721-553c6427717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2094e607f7bf4345beb838fc2e483911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:13:06Z,use_quota=True,user_id='d856ca6f15d74ea483e6c02dee0e0dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:05.779001 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baf0152-9d5c-446f-b94c-1545f8b6e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:05.783153 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baf0152-9d5c-446f-b94c-1545f8b6e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:05.788392 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33b0090-4d8f-44c8-bfdf-469fcfa89222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:05.792745 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33b0090-4d8f-44c8-bfdf-469fcfa89222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e215f7-2439-4ab4-8721-553c6427717e', 'volume_name': 'volume-a6e215f7-2439-4ab4-8721-553c6427717e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:05.797745 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8113190e-c6a4-4d9b-bc28-b9c4ee2b61b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:05.801821 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8113190e-c6a4-4d9b-bc28-b9c4ee2b61b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:05.807265 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e75f7f-dd65-4ffb-b945-8a4d51c05375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:05.808368 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Volume a6e215f7-2439-4ab4-8721-553c6427717e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e215f7-2439-4ab4-8721-553c6427717e', 'volume_size': 1} Feb 12 21:13:05.808773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] creating volume 'volume-a6e215f7-2439-4ab4-8721-553c6427717e' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:13:05.809814 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:13:06.906889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:13:06.908006 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:13:06.912388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e75f7f-dd65-4ffb-b945-8a4d51c05375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e215f7-2439-4ab4-8721-553c6427717e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:06.918478 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d11e88-0b0d-48bd-862d-af3a4e4d568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:07.018174 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Volume volume-a6e215f7-2439-4ab4-8721-553c6427717e (a6e215f7-2439-4ab4-8721-553c6427717e): created successfully Feb 12 21:13:07.027940 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d11e88-0b0d-48bd-862d-af3a4e4d568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:07.047251 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Flow 'volume_create_manager' (d7351c23-e8e4-4a86-acf2-53a5fbb10204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:13:07.142947 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e0d240ea-921d-43d5-b1b1-6b95c36e1094 tempest-AttachVolumeShelveTestJSON-271936705 None] Created volume successfully. Feb 12 21:13:07.161865 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:13:07.162854 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:13:07.213802 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:13:07.266266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:13:14.233096 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:13:14.239551 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:13:14.240149 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:13:14.262387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Flow 'volume_create_manager' (c7080fbf-553c-4499-a35c-23e470a2c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:13:14.269130 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb95d835-f362-40ea-9bbd-73773534b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:14.278035 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:13:14.293861 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb95d835-f362-40ea-9bbd-73773534b354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1822172585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0fcd13f9-de29-40a0-a872-022fc9be509b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9fbd43632c4530b8d993cde9cd2106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:13:14Z,use_quota=True,user_id='d75cf4e88d6e4dcc82408554aa0cb6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:14.300089 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e898bd9-eb12-4476-b2e9-fe0131856952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:14.304574 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e898bd9-eb12-4476-b2e9-fe0131856952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:14.310086 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed75f59-2ccd-4edd-8f78-0c99c58dcfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:14.314651 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed75f59-2ccd-4edd-8f78-0c99c58dcfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcd13f9-de29-40a0-a872-022fc9be509b', 'volume_name': 'volume-0fcd13f9-de29-40a0-a872-022fc9be509b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:14.320582 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfee4ad6-2114-4117-a942-046d067f799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:14.325979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfee4ad6-2114-4117-a942-046d067f799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:14.331591 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c91c35-a355-4aee-bce2-12e5cc76cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:14.332789 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume 0fcd13f9-de29-40a0-a872-022fc9be509b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcd13f9-de29-40a0-a872-022fc9be509b', 'volume_size': 1} Feb 12 21:13:14.333215 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] creating volume 'volume-0fcd13f9-de29-40a0-a872-022fc9be509b' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:13:14.334260 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:13:15.652437 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:13:15.652981 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:13:15.656625 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c91c35-a355-4aee-bce2-12e5cc76cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcd13f9-de29-40a0-a872-022fc9be509b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:15.661683 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd347ac-883d-420d-8175-313767144204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:15.759784 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume volume-0fcd13f9-de29-40a0-a872-022fc9be509b (0fcd13f9-de29-40a0-a872-022fc9be509b): created successfully Feb 12 21:13:15.764426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd347ac-883d-420d-8175-313767144204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:15.771790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Flow 'volume_create_manager' (c7080fbf-553c-4499-a35c-23e470a2c47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:13:15.856642 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9defdfd1-75c2-4b6a-8017-7f5b453b4bb6 tempest-ServerRescueNegativeTestJSON-1489443139 None] Created volume successfully. Feb 12 21:13:41.600692 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:13:41.612021 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:13:41.612021 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:13:41.637671 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Flow 'volume_create_manager' (cb38116d-8da1-48ff-ba83-fe55c0f0d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:13:41.645577 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a87093-d43a-466d-b159-3fdd33373f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:41.654027 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:13:41.673452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a87093-d43a-466d-b159-3fdd33373f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1680254767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f467ea62-0ab8-4471-b457-237b5ad7e6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9fbd43632c4530b8d993cde9cd2106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:13:41Z,use_quota=True,user_id='d75cf4e88d6e4dcc82408554aa0cb6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:41.683205 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d277769-2be9-43bd-bd3e-84989c7dff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:41.688623 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d277769-2be9-43bd-bd3e-84989c7dff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:41.696275 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0f020e-d9e7-402a-b344-ed415efded60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:41.705697 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0f020e-d9e7-402a-b344-ed415efded60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'volume_name': 'volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:41.713173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eea013-2917-453a-b42b-bc5aeda3770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:41.721648 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eea013-2917-453a-b42b-bc5aeda3770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:41.730520 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f89a3c1-a73b-4ee5-b6e9-972560ec3745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:41.731994 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume f467ea62-0ab8-4471-b457-237b5ad7e6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'volume_size': 1} Feb 12 21:13:41.732732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] creating volume 'volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:13:41.734790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:13:43.114326 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:13:43.119044 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:13:43.124000 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f89a3c1-a73b-4ee5-b6e9-972560ec3745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:43.132176 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c7f326-1549-4fa9-8bb4-56966c7e47a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:13:43.256266 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5 (f467ea62-0ab8-4471-b457-237b5ad7e6a5): created successfully Feb 12 21:13:43.264940 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c7f326-1549-4fa9-8bb4-56966c7e47a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:13:43.276793 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Flow 'volume_create_manager' (cb38116d-8da1-48ff-ba83-fe55c0f0d45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:13:43.396389 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ab4207b1-2852-4835-b914-14e52bafb482 tempest-ServerRescueNegativeTestJSON-1489443139 None] Created volume successfully. Feb 12 21:13:45.110026 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-e71c4ab2-a356-49d2-bd5a-229594784db3 req-8291fb12-7529-40db-bd3f-4c3fe4448faa tempest-ServerRescueNegativeTestJSON-1489443139 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:13:46.367976 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-e71c4ab2-a356-49d2-bd5a-229594784db3 req-8291fb12-7529-40db-bd3f-4c3fe4448faa tempest-ServerRescueNegativeTestJSON-1489443139 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.258s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:13:46.369949 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e71c4ab2-a356-49d2-bd5a-229594784db3 req-8291fb12-7529-40db-bd3f-4c3fe4448faa tempest-ServerRescueNegativeTestJSON-1489443139 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:13:46.476597 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e71c4ab2-a356-49d2-bd5a-229594784db3 req-8291fb12-7529-40db-bd3f-4c3fe4448faa tempest-ServerRescueNegativeTestJSON-1489443139 None] Connection info returned from driver {'name': 'volumes/volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f467ea62-0ab8-4471-b457-237b5ad7e6a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8f603181-15cb-43f1-8f97-aa4841d8b742'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:13:46.631334 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-e71c4ab2-a356-49d2-bd5a-229594784db3 req-8291fb12-7529-40db-bd3f-4c3fe4448faa tempest-ServerRescueNegativeTestJSON-1489443139 None] attachment_update completed successfully. Feb 12 21:14:07.163906 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:14:07.166084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:07.205663 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:07.240740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:14:13.931178 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:14:13.935085 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:14:13.935578 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:14:13.956563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Flow 'volume_create_manager' (c1138248-b4ae-4f18-9c06-5abe8be813d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:14:13.964217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5c9288-9f0e-47c1-8a3f-f0e8551fe619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:14:13.971497 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:14:13.985769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5c9288-9f0e-47c1-8a3f-f0e8551fe619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-274744575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e8cb03f3-163b-4e9d-bbc6-451e75bc5c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3339620b21d4394a171733276444b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:14:14Z,use_quota=True,user_id='daa98fa6e3104489af8bd77f8217a07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:14:13.991809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42b7567-3d4a-4b1d-afe6-7a270706b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:14:13.996101 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42b7567-3d4a-4b1d-afe6-7a270706b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:14:14.001461 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed121df9-be2d-4de5-b270-351c8db1f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:14:14.005942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed121df9-be2d-4de5-b270-351c8db1f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'volume_name': 'volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:14:14.011393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1de135-56ff-405e-ba53-fddc25668072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:14:14.015442 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1de135-56ff-405e-ba53-fddc25668072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:14:14.020402 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cfedee-bac2-48de-b8ba-10914b2c6f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:14:14.026336 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Volume e8cb03f3-163b-4e9d-bbc6-451e75bc5c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'volume_size': 1} Feb 12 21:14:14.027673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] creating volume 'volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:14:14.029087 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:15.154933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:14:15.158237 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:14:15.162664 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cfedee-bac2-48de-b8ba-10914b2c6f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:14:15.168131 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d1e015-a7ee-4457-8075-eb87be02dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:14:15.285207 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Volume volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82 (e8cb03f3-163b-4e9d-bbc6-451e75bc5c82): created successfully Feb 12 21:14:15.289768 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d1e015-a7ee-4457-8075-eb87be02dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:14:15.296236 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Flow 'volume_create_manager' (c1138248-b4ae-4f18-9c06-5abe8be813d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:14:15.378914 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a47abaf8-f8c7-48f9-a975-a1fac7348573 tempest-AttachVolumeNegativeTest-377263399 None] Created volume successfully. Feb 12 21:14:17.111463 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 req-6434fd16-05ed-4b92-84c7-ab4ab5ac290e tempest-AttachVolumeNegativeTest-377263399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:14:18.129827 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 req-6434fd16-05ed-4b92-84c7-ab4ab5ac290e tempest-AttachVolumeNegativeTest-377263399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.019s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:14:18.131284 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 req-6434fd16-05ed-4b92-84c7-ab4ab5ac290e tempest-AttachVolumeNegativeTest-377263399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:14:18.308310 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 req-6434fd16-05ed-4b92-84c7-ab4ab5ac290e tempest-AttachVolumeNegativeTest-377263399 None] Connection info returned from driver {'name': 'volumes/volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e8cb03f3-163b-4e9d-bbc6-451e75bc5c82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0fd98e81-29d0-404a-b50f-d2c621be4248'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:14:18.507495 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 req-6434fd16-05ed-4b92-84c7-ab4ab5ac290e tempest-AttachVolumeNegativeTest-377263399 None] attachment_update completed successfully. Feb 12 21:14:24.694777 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 req-71c62ed8-7bb6-40e8-8d3e-db3c2307c1b7 tempest-ServerRescueNegativeTestJSON-1489443139 None] Terminate volume connection completed successfully. Feb 12 21:14:24.696547 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 req-71c62ed8-7bb6-40e8-8d3e-db3c2307c1b7 tempest-ServerRescueNegativeTestJSON-1489443139 None] Deleting attachment 8f603181-15cb-43f1-8f97-aa4841d8b742. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:26.783113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] Lock "b'cinder-f467ea62-0ab8-4471-b457-237b5ad7e6a5-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:14:26.940713 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:27.409440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:14:27.410132 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:14:27.708965 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] deleting rbd volume volume-f467ea62-0ab8-4471-b457-237b5ad7e6a5 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:14:37.810149 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] Created reservations ['1f262943-d0e3-4de6-8d53-5df3d6d563e4', '06271113-cc20-45c8-90b9-6ef3c0c5c71d', '3b9990cc-8bd8-4c1f-82ba-22ef2ecaaa55', '92e5ab82-912f-43df-b579-a3dc97c9f2dc'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:14:38.033343 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:38.137813 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:38.171680 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:14:38.179755 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] Deleted volume successfully. Feb 12 21:14:38.271819 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-27a5a69a-aa6a-47e7-a184-428ecee65f9a tempest-ServerRescueNegativeTestJSON-1489443139 None] Lock "b'cinder-f467ea62-0ab8-4471-b457-237b5ad7e6a5-delete_volume'" released by "delete_volume" :: held 11.489s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:14:38.788345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 req-5ac6d394-f666-45f6-9e78-d5d3ff89cded tempest-AttachVolumeShelveTestJSON-271936705 None] No connector for attachment 738c2f6b-90f2-49f5-9d55-457144d30bbb; skipping storage backend terminate_connection call. {{(pid=134690) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4915}} Feb 12 21:14:38.788982 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 req-5ac6d394-f666-45f6-9e78-d5d3ff89cded tempest-AttachVolumeShelveTestJSON-271936705 None] Deleting attachment 738c2f6b-90f2-49f5-9d55-457144d30bbb. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:38.851036 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] Lock "b'cinder-0fcd13f9-de29-40a0-a872-022fc9be509b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:14:38.965586 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:39.220626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:14:39.221233 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] Volume volume-0fcd13f9-de29-40a0-a872-022fc9be509b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:14:39.576446 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] deleting rbd volume volume-0fcd13f9-de29-40a0-a872-022fc9be509b {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:14:41.747580 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab req-32d43c5e-61aa-4769-aa21-91aea8fdc6b7 tempest-AttachVolumeNegativeTest-377263399 None] Terminate volume connection completed successfully. Feb 12 21:14:41.748934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab req-32d43c5e-61aa-4769-aa21-91aea8fdc6b7 tempest-AttachVolumeNegativeTest-377263399 None] Deleting attachment 0fd98e81-29d0-404a-b50f-d2c621be4248. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:47.966946 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-27c3ff21-4792-432e-a2cb-6ee030f930fa tempest-ServersTestBootFromVolume-814782321 None] Terminate volume connection completed successfully. Feb 12 21:14:47.967618 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-27c3ff21-4792-432e-a2cb-6ee030f930fa tempest-ServersTestBootFromVolume-814782321 None] Deleting attachment 8f3f6a00-bb7a-46c8-a79e-f39050786bda. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:48.496415 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] Created reservations ['6ae3ddd1-f570-4f0b-bd5a-64c1e1d1fd8e', '90d8c065-a859-490a-b55f-fd73006565cd', '94186740-587c-447d-8899-272c931d28ea', '497dadb7-919c-4185-a281-651f2fbe369f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:14:48.563303 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] Lock "b'cinder-d3c7c811-d95c-47ea-9db2-985a51feb590-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:14:48.724589 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:49.061085 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:14:49.280681 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] deleting rbd volume volume-d3c7c811-d95c-47ea-9db2-985a51feb590 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:14:49.286419 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:49.354860 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:14:49.424313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:14:49.432806 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] Deleted volume successfully. Feb 12 21:14:49.529090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-dc8a9f6c-ac44-43b8-953c-97e864d822da tempest-ServerRescueNegativeTestJSON-1489443139 None] Lock "b'cinder-0fcd13f9-de29-40a0-a872-022fc9be509b-delete_volume'" released by "delete_volume" :: held 10.678s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:14:51.216638 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-4e108e37-8cf9-4066-816d-34eb2921cf16 req-18ccac09-8176-4942-bde7-52e828ae34c8 tempest-TaggedBootDevicesTest_v242-633755402 None] Terminate volume connection completed successfully. Feb 12 21:14:51.217391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-4e108e37-8cf9-4066-816d-34eb2921cf16 req-18ccac09-8176-4942-bde7-52e828ae34c8 tempest-TaggedBootDevicesTest_v242-633755402 None] Deleting attachment f5b20040-9c6c-4514-9a1d-a1f083bb385b. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:51.525406 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-4e108e37-8cf9-4066-816d-34eb2921cf16 req-2b30daf5-e387-4af4-8503-925e908fadad tempest-TaggedBootDevicesTest_v242-633755402 None] Terminate volume connection completed successfully. Feb 12 21:14:51.526797 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-4e108e37-8cf9-4066-816d-34eb2921cf16 req-2b30daf5-e387-4af4-8503-925e908fadad tempest-TaggedBootDevicesTest_v242-633755402 None] Deleting attachment ff0bf8f8-3c09-4ac6-9e3a-efc1896fe2eb. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:51.743810 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-4e108e37-8cf9-4066-816d-34eb2921cf16 req-8212b3c1-4755-4354-bec7-d33999de9d03 tempest-TaggedBootDevicesTest_v242-633755402 None] Terminate volume connection completed successfully. Feb 12 21:14:51.745047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-4e108e37-8cf9-4066-816d-34eb2921cf16 req-8212b3c1-4755-4354-bec7-d33999de9d03 tempest-TaggedBootDevicesTest_v242-633755402 None] Deleting attachment ae9a17ef-e9de-4a6e-8045-15272b450116. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:14:59.603181 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:14:59.941778 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] deleting parent snapshot volume-d3c7c811-d95c-47ea-9db2-985a51feb590.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:15:05.186342 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-6fe52308-5497-4bfa-92db-ef7959731976-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:05.283670 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] Created reservations ['106eb9a9-5a55-4ec1-80f5-e2d4cb7bf3e1', 'd59d14b3-5de3-46ea-80d4-61ec06c0a325', '07cea74e-9eb2-4868-9606-513580eb603d', '23c5eb60-d815-4377-9058-8fb3a4782ef8'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:15:05.358776 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:05.574417 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:05.574959 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume volume-6fe52308-5497-4bfa-92db-ef7959731976 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:15:05.777037 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] deleting rbd volume volume-6fe52308-5497-4bfa-92db-ef7959731976 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:15:05.918392 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:06.016014 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:06.076603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:06.088177 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] Deleted volume successfully. Feb 12 21:15:06.196954 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-41ad1de9-02da-451b-9463-40fbd4384b8e req-4b7c8bd9-910a-41bd-b429-5306f2668660 tempest-ServersTestBootFromVolume-814782321 None] Lock "b'cinder-d3c7c811-d95c-47ea-9db2-985a51feb590-delete_volume'" released by "delete_volume" :: held 17.636s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:15:07.142089 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:15:07.149337 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:15:07.149521 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:15:07.174342 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Flow 'volume_create_manager' (3a1ca2a9-7e0f-4238-a9cc-cee801c76452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:15:07.180881 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4b205f-b8d3-4cc1-bb2c-8a10ac074387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:07.184729 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:15:07.186184 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:07.228426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:07.306626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:07.317768 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:15:07.336484 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4b205f-b8d3-4cc1-bb2c-8a10ac074387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2048118416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d348faed-78ec-43fc-8464-e57b63f9a261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3339620b21d4394a171733276444b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:15:07Z,use_quota=True,user_id='daa98fa6e3104489af8bd77f8217a07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:07.344226 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab89b3c2-a1f3-48dd-a55e-05b59c04b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:07.348912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab89b3c2-a1f3-48dd-a55e-05b59c04b980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:07.374823 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c720eb17-ce55-44df-949e-01749016a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:07.379506 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c720eb17-ce55-44df-949e-01749016a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd348faed-78ec-43fc-8464-e57b63f9a261', 'volume_name': 'volume-d348faed-78ec-43fc-8464-e57b63f9a261', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:07.386055 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1682bb9b-a628-4b6b-9c95-96b1666533c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:07.406249 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1682bb9b-a628-4b6b-9c95-96b1666533c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:07.412614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f2088b-e087-4776-94e3-582cf6392e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:07.414628 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Volume d348faed-78ec-43fc-8464-e57b63f9a261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d348faed-78ec-43fc-8464-e57b63f9a261', 'volume_size': 1} Feb 12 21:15:07.415316 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] creating volume 'volume-d348faed-78ec-43fc-8464-e57b63f9a261' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:15:07.416876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:08.834812 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:15:08.836135 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:15:08.840121 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f2088b-e087-4776-94e3-582cf6392e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d348faed-78ec-43fc-8464-e57b63f9a261', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:08.846819 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b3ffbe-096e-462c-a0b1-be6c7c4eb4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:08.938195 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Volume volume-d348faed-78ec-43fc-8464-e57b63f9a261 (d348faed-78ec-43fc-8464-e57b63f9a261): created successfully Feb 12 21:15:08.943347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b3ffbe-096e-462c-a0b1-be6c7c4eb4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:08.951142 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Flow 'volume_create_manager' (3a1ca2a9-7e0f-4238-a9cc-cee801c76452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:15:09.043276 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a574b7e9-241a-42e2-8c39-5e48d65367f9 tempest-AttachVolumeNegativeTest-377263399 None] Created volume successfully. Feb 12 21:15:11.362313 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-77668828-c7ef-4d5b-b15c-fdc204310e87 req-0b9d9d98-2996-4c69-a670-e5bd7b3a09a2 tempest-AttachVolumeNegativeTest-377263399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:15:12.266206 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-77668828-c7ef-4d5b-b15c-fdc204310e87 req-0b9d9d98-2996-4c69-a670-e5bd7b3a09a2 tempest-AttachVolumeNegativeTest-377263399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.904s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:15:12.267195 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-77668828-c7ef-4d5b-b15c-fdc204310e87 req-0b9d9d98-2996-4c69-a670-e5bd7b3a09a2 tempest-AttachVolumeNegativeTest-377263399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d348faed-78ec-43fc-8464-e57b63f9a261', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'd348faed-78ec-43fc-8464-e57b63f9a261', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:15:12.391587 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-77668828-c7ef-4d5b-b15c-fdc204310e87 req-0b9d9d98-2996-4c69-a670-e5bd7b3a09a2 tempest-AttachVolumeNegativeTest-377263399 None] Connection info returned from driver {'name': 'volumes/volume-d348faed-78ec-43fc-8464-e57b63f9a261', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd348faed-78ec-43fc-8464-e57b63f9a261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '74e14fee-55a3-4cd0-8149-e260da7f9603'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:15:12.567243 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-77668828-c7ef-4d5b-b15c-fdc204310e87 req-0b9d9d98-2996-4c69-a670-e5bd7b3a09a2 tempest-AttachVolumeNegativeTest-377263399 None] attachment_update completed successfully. Feb 12 21:15:13.643688 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] Created reservations ['4f031424-150c-4783-b54d-8326f7240e7a', 'b3d43cc8-6c5c-4f9e-9f63-b96415478cd6', '2c59e8ca-1f8c-40af-8fbf-307980cfd8d1', '7ea37da9-aa61-497e-8e65-75b53d6176db'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:15:13.907912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:14.197561 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:14.241010 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:14.257464 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] Deleted volume successfully. Feb 12 21:15:14.269500 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-e81831ca-45fb-4913-9901-1313416408ea-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:14.373611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b8698010-8dc8-4f13-bb66-b255342dd0f8 tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-6fe52308-5497-4bfa-92db-ef7959731976-delete_volume'" released by "delete_volume" :: held 9.188s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:15:14.499838 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:14.803261 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:14.803867 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] Volume volume-e81831ca-45fb-4913-9901-1313416408ea is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:15:14.934032 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] deleting rbd volume volume-e81831ca-45fb-4913-9901-1313416408ea {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:15:16.931038 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-fde8bfff-a148-4eba-a832-dad7fc507f0a req-7a932c1b-b4c2-43f7-9004-b03ac234599a tempest-AttachVolumeNegativeTest-377263399 None] Terminate volume connection completed successfully. Feb 12 21:15:16.932736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-fde8bfff-a148-4eba-a832-dad7fc507f0a req-7a932c1b-b4c2-43f7-9004-b03ac234599a tempest-AttachVolumeNegativeTest-377263399 None] Deleting attachment 74e14fee-55a3-4cd0-8149-e260da7f9603. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:15:22.606825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] Created reservations ['d3fc087c-8720-45fb-923b-036930578865', '706ffe0a-d7fb-457f-b935-89b702e81d5b', '6631e256-fac4-4b5b-9571-ed0ceee1ea27', 'af0da5f2-a8d6-4e6f-b207-bc22727dbfba'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:15:22.877947 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:22.940466 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:23.018170 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:23.030636 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] Deleted volume successfully. Feb 12 21:15:23.115041 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-7c79dff3-d53d-4ae9-a438-23dc0e39df0e-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:23.148406 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-54bd8a49-9676-4fba-b89c-9aaa4426e3d4 tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-e81831ca-45fb-4913-9901-1313416408ea-delete_volume'" released by "delete_volume" :: held 8.879s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:15:23.282611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:23.666958 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:23.928271 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] deleting rbd volume volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:15:33.236805 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:15:33.513166 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] deleting parent snapshot volume-7c79dff3-d53d-4ae9-a438-23dc0e39df0e.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:15:37.532824 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] Created reservations ['d5e552d0-1823-44a1-b895-6fa819b48223', '39d329ce-6c52-43f1-980a-013c1141a7f2', 'acd7de88-c440-42b5-bd54-ab3fa6b78efe', 'b6fcf79d-7267-4da1-aac3-66435678b266'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:15:37.622402 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:15:37.626445 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:15:37.626972 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:15:37.648571 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Flow 'volume_create_manager' (8affb184-6c6b-4524-b1ed-507b4fbaea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:15:37.656878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd7be1-d7e2-40d4-9e61-52c4b37fe0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:37.666924 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:15:37.685142 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd7be1-d7e2-40d4-9e61-52c4b37fe0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-441826402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a5cc769-00c9-4456-9c95-a53bbc50a390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3339620b21d4394a171733276444b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:15:34Z,use_quota=True,user_id='daa98fa6e3104489af8bd77f8217a07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:37.690979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96907334-fb09-42a9-a51c-12c7527a50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:37.695224 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96907334-fb09-42a9-a51c-12c7527a50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:37.701032 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4301d32d-9f52-4dc6-95df-418430757846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:37.705556 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4301d32d-9f52-4dc6-95df-418430757846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a5cc769-00c9-4456-9c95-a53bbc50a390', 'volume_name': 'volume-9a5cc769-00c9-4456-9c95-a53bbc50a390', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:37.710575 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32477b76-fd3a-4974-adca-bf6f12f1160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:37.714591 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32477b76-fd3a-4974-adca-bf6f12f1160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:37.719430 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcf2632-0f26-41d7-9967-841221e526c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:37.720569 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Volume 9a5cc769-00c9-4456-9c95-a53bbc50a390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a5cc769-00c9-4456-9c95-a53bbc50a390', 'volume_size': 1} Feb 12 21:15:37.720959 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] creating volume 'volume-9a5cc769-00c9-4456-9c95-a53bbc50a390' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:15:37.721976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:37.894177 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:37.960259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:37.997970 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:38.002842 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] Deleted volume successfully. Feb 12 21:15:38.235373 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-380c1e48-0e67-4ecf-84fe-be8e53e5040a tempest-TaggedBootDevicesTest_v242-633755402 None] Lock "b'cinder-7c79dff3-d53d-4ae9-a438-23dc0e39df0e-delete_volume'" released by "delete_volume" :: held 15.084s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:15:38.938202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:15:38.938202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:15:38.940539 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcf2632-0f26-41d7-9967-841221e526c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a5cc769-00c9-4456-9c95-a53bbc50a390', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:38.946649 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1066e55a-31ed-43d0-bd25-25c863b9ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:39.019994 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Volume volume-9a5cc769-00c9-4456-9c95-a53bbc50a390 (9a5cc769-00c9-4456-9c95-a53bbc50a390): created successfully Feb 12 21:15:39.025884 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1066e55a-31ed-43d0-bd25-25c863b9ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:39.039500 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Flow 'volume_create_manager' (8affb184-6c6b-4524-b1ed-507b4fbaea4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:15:39.116106 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-fe70d465-3e6b-4036-8bba-472b247981b8 tempest-AttachVolumeNegativeTest-377263399 None] Created volume successfully. Feb 12 21:15:41.065036 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 req-4c2600ee-363e-4212-9bf5-a87b35476b3b tempest-AttachVolumeNegativeTest-377263399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:15:42.224685 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 req-4c2600ee-363e-4212-9bf5-a87b35476b3b tempest-AttachVolumeNegativeTest-377263399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.160s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:15:42.225595 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 req-4c2600ee-363e-4212-9bf5-a87b35476b3b tempest-AttachVolumeNegativeTest-377263399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9a5cc769-00c9-4456-9c95-a53bbc50a390', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '9a5cc769-00c9-4456-9c95-a53bbc50a390', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:15:42.348527 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 req-4c2600ee-363e-4212-9bf5-a87b35476b3b tempest-AttachVolumeNegativeTest-377263399 None] Connection info returned from driver {'name': 'volumes/volume-9a5cc769-00c9-4456-9c95-a53bbc50a390', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9a5cc769-00c9-4456-9c95-a53bbc50a390', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'beee5f16-e9ad-4b69-b7b8-8f406eef3ff0'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:15:42.486605 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 req-4c2600ee-363e-4212-9bf5-a87b35476b3b tempest-AttachVolumeNegativeTest-377263399 None] attachment_update completed successfully. Feb 12 21:15:47.465584 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-1b283c38-9601-4833-a375-21c88c3e83a0 req-7d04c0ed-044b-463a-af41-36a6723a4bb8 tempest-AttachVolumeNegativeTest-377263399 None] Terminate volume connection completed successfully. Feb 12 21:15:47.466152 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-1b283c38-9601-4833-a375-21c88c3e83a0 req-7d04c0ed-044b-463a-af41-36a6723a4bb8 tempest-AttachVolumeNegativeTest-377263399 None] Deleting attachment beee5f16-e9ad-4b69-b7b8-8f406eef3ff0. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:15:49.254632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] Lock "b'cinder-9a5cc769-00c9-4456-9c95-a53bbc50a390-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:49.432889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:49.704174 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:49.704623 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] Volume volume-9a5cc769-00c9-4456-9c95-a53bbc50a390 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:15:49.825443 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] deleting rbd volume volume-9a5cc769-00c9-4456-9c95-a53bbc50a390 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:15:53.107632 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-0393537b-a418-4062-893d-f25933d3cb56 req-a6ff39ac-e596-4ee8-a386-b9f342e6384d tempest-TaggedBootDevicesTest-172445176 None] Terminate volume connection completed successfully. Feb 12 21:15:53.110638 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-0393537b-a418-4062-893d-f25933d3cb56 req-a6ff39ac-e596-4ee8-a386-b9f342e6384d tempest-TaggedBootDevicesTest-172445176 None] Deleting attachment 431ce69e-95d4-4476-a6d2-de0e950a4c7f. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:15:53.351340 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] Created reservations ['b5407153-f38d-474b-b161-ca8ac2dc680d', '1e7900a6-cf7b-4660-a24b-e9075303d7d8', 'e7a4c56c-b2c0-4be9-8335-f62139a9a91a', '721f7463-46f1-4bf7-ab12-d150c06f37bd'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:15:53.438566 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] Lock "b'cinder-a6e215f7-2439-4ab4-8721-553c6427717e-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:53.472610 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-0393537b-a418-4062-893d-f25933d3cb56 req-ee97e167-db87-4fab-9f42-55bb6e88b39b tempest-TaggedBootDevicesTest-172445176 None] Terminate volume connection completed successfully. Feb 12 21:15:53.473253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-0393537b-a418-4062-893d-f25933d3cb56 req-ee97e167-db87-4fab-9f42-55bb6e88b39b tempest-TaggedBootDevicesTest-172445176 None] Deleting attachment 99969a56-838a-4667-8fd0-545b285f45ef. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:15:53.570868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:53.739536 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:53.739986 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] Volume volume-a6e215f7-2439-4ab4-8721-553c6427717e is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:15:53.838954 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] deleting rbd volume volume-a6e215f7-2439-4ab4-8721-553c6427717e {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:15:53.848217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:53.931013 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:54.008160 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:54.019813 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] Deleted volume successfully. Feb 12 21:15:54.033775 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-0393537b-a418-4062-893d-f25933d3cb56 req-7494ec9f-24aa-4e83-932e-5c5bfae30019 tempest-TaggedBootDevicesTest-172445176 None] Terminate volume connection completed successfully. Feb 12 21:15:54.034228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-0393537b-a418-4062-893d-f25933d3cb56 req-7494ec9f-24aa-4e83-932e-5c5bfae30019 tempest-TaggedBootDevicesTest-172445176 None] Deleting attachment 940ca346-e9ef-4cc8-bab0-665c0b73f46d. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:15:54.123187 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f8fb4916-c3d2-43a0-9f60-5948e6fdbbbe tempest-AttachVolumeNegativeTest-377263399 None] Lock "b'cinder-9a5cc769-00c9-4456-9c95-a53bbc50a390-delete_volume'" released by "delete_volume" :: held 4.869s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:15:55.820949 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:15:55.828089 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:15:55.828809 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:15:55.855888 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Flow 'volume_create_manager' (5b5ba86c-2e50-4aef-98b4-68e12782a3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:15:55.863569 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de029617-e4e4-4561-9665-dfa0ef0d39cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:55.873862 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:15:55.890657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de029617-e4e4-4561-9665-dfa0ef0d39cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-779981440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=529282b2-ffa4-43d7-8822-61c791cd9d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88ed10d0c57403dbc48251e998fbd1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:15:56Z,use_quota=True,user_id='7af0023ef6e54079aa852f3d20e829f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:55.896372 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fea12fd-c7b2-4f63-bc04-814740164f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:55.901397 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fea12fd-c7b2-4f63-bc04-814740164f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:55.908013 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb285bfc-baa9-416e-94a8-eadb3c281b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:55.913732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb285bfc-baa9-416e-94a8-eadb3c281b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529282b2-ffa4-43d7-8822-61c791cd9d78', 'volume_name': 'volume-529282b2-ffa4-43d7-8822-61c791cd9d78', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:55.919792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b29b3db-ab66-4d33-af7f-b280f1eac44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:55.924063 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b29b3db-ab66-4d33-af7f-b280f1eac44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:55.938838 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbba1d0-fa8a-4ee2-b074-c6ecdbb6c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:55.944632 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Volume 529282b2-ffa4-43d7-8822-61c791cd9d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529282b2-ffa4-43d7-8822-61c791cd9d78', 'volume_size': 1} Feb 12 21:15:55.945878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] creating volume 'volume-529282b2-ffa4-43d7-8822-61c791cd9d78' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:15:55.948920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:56.826687 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:15:56.827321 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:15:56.830943 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbba1d0-fa8a-4ee2-b074-c6ecdbb6c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529282b2-ffa4-43d7-8822-61c791cd9d78', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:56.838821 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f1ba34-3fe8-40c7-850f-cad1ff66cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:15:56.949643 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Volume volume-529282b2-ffa4-43d7-8822-61c791cd9d78 (529282b2-ffa4-43d7-8822-61c791cd9d78): created successfully Feb 12 21:15:56.953530 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f1ba34-3fe8-40c7-850f-cad1ff66cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:15:56.968245 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Flow 'volume_create_manager' (5b5ba86c-2e50-4aef-98b4-68e12782a3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:15:57.071020 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-87199021-8b24-4797-9a3a-38506d280b7d tempest-DeleteServersTestJSON-1687401015 None] Created volume successfully. Feb 12 21:15:58.055381 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] Created reservations ['41988317-e845-4b73-9334-5bb76a8b8174', '6227a4c7-436a-4ff9-8e35-223445b8f9ae', 'b8eecbe8-3875-485b-b89a-85ab48967744', '0acaf5d8-a24f-414f-87df-cab1b207b3be'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:15:58.205667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:58.297161 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:58.338863 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:15:58.350062 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] Deleted volume successfully. Feb 12 21:15:58.477519 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-66adeeea-3754-42d3-a3b4-dcaa8fb19339 tempest-AttachVolumeShelveTestJSON-271936705 None] Lock "b'cinder-a6e215f7-2439-4ab4-8721-553c6427717e-delete_volume'" released by "delete_volume" :: held 5.040s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:15:58.671842 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7dcb042a-4b80-4b85-8e82-66df892d2705 req-bb9d9ef6-a1c2-4d10-88f9-99217ff41fdb tempest-DeleteServersTestJSON-1687401015 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:15:58.736405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] Lock "b'cinder-d348faed-78ec-43fc-8464-e57b63f9a261-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:58.901292 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:59.133240 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:59.134680 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] Volume volume-d348faed-78ec-43fc-8464-e57b63f9a261 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:15:59.225754 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] deleting rbd volume volume-d348faed-78ec-43fc-8464-e57b63f9a261 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:15:59.264646 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] Lock "b'cinder-5583872c-2e0a-476f-bbb0-bfbbf03d7db2-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:15:59.422933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:15:59.791818 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:15:59.795572 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] Volume volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:16:00.043998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] deleting rbd volume volume-5583872c-2e0a-476f-bbb0-bfbbf03d7db2 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:16:00.046425 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-7dcb042a-4b80-4b85-8e82-66df892d2705 req-bb9d9ef6-a1c2-4d10-88f9-99217ff41fdb tempest-DeleteServersTestJSON-1687401015 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.375s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:16:00.047269 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-7dcb042a-4b80-4b85-8e82-66df892d2705 req-bb9d9ef6-a1c2-4d10-88f9-99217ff41fdb tempest-DeleteServersTestJSON-1687401015 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-529282b2-ffa4-43d7-8822-61c791cd9d78', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '529282b2-ffa4-43d7-8822-61c791cd9d78', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:16:00.133582 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-7dcb042a-4b80-4b85-8e82-66df892d2705 req-bb9d9ef6-a1c2-4d10-88f9-99217ff41fdb tempest-DeleteServersTestJSON-1687401015 None] Connection info returned from driver {'name': 'volumes/volume-529282b2-ffa4-43d7-8822-61c791cd9d78', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '529282b2-ffa4-43d7-8822-61c791cd9d78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ac34f295-03ef-4eac-8038-ab41897486e0'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:16:00.306611 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-7dcb042a-4b80-4b85-8e82-66df892d2705 req-bb9d9ef6-a1c2-4d10-88f9-99217ff41fdb tempest-DeleteServersTestJSON-1687401015 None] attachment_update completed successfully. Feb 12 21:16:02.078366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-2abea7c0-bbed-4f39-8231-884740b5d70b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:16:02.192348 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:02.476088 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:16:02.476544 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] Volume volume-2abea7c0-bbed-4f39-8231-884740b5d70b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:16:02.614219 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] deleting rbd volume volume-2abea7c0-bbed-4f39-8231-884740b5d70b {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:16:06.177335 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-4174c309-cec9-4577-9098-9205e990fb36 req-f7fa9028-6d7b-479f-affa-4de8428dbade tempest-DeleteServersTestJSON-1687401015 None] Terminate volume connection completed successfully. Feb 12 21:16:06.178449 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-4174c309-cec9-4577-9098-9205e990fb36 req-f7fa9028-6d7b-479f-affa-4de8428dbade tempest-DeleteServersTestJSON-1687401015 None] Deleting attachment ac34f295-03ef-4eac-8038-ab41897486e0. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:16:06.730071 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] Created reservations ['0b5cf3ac-ed39-4e83-b1b7-f426769c533e', 'd83058ee-5615-45a2-bce2-4f9cbf4c2287', 'd3c08def-9da8-4bc6-b4ad-93939cf14c89', '8b9b1cde-a69a-49bb-8d54-9678af2bcf5a'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:16:06.905319 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:06.943514 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:06.969090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:06.973134 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] Deleted volume successfully. Feb 12 21:16:07.139459 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f82d639d-956f-4ee5-8249-12892b840c8c tempest-AttachVolumeNegativeTest-377263399 None] Lock "b'cinder-d348faed-78ec-43fc-8464-e57b63f9a261-delete_volume'" released by "delete_volume" :: held 8.403s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:16:07.179084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] Created reservations ['a32f1a3e-c77f-4f3f-aebb-dd0d8fe14dbf', '26174d77-7424-4a3b-a684-3069b5514a5b', '6a5463c9-e966-4206-ad56-82b5c2ac54a9', '7de4d6af-690d-4c2c-bccc-dd1a0411e300'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:16:07.183462 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:16:07.184449 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:07.214565 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:07.272905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:07.539823 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:07.605523 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:07.661057 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:07.665028 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] Deleted volume successfully. Feb 12 21:16:07.791880 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5fe560a7-de48-464d-993a-a232bc8a1274 tempest-AttachVolumeShelveTestJSON-271936705 None] Lock "b'cinder-5583872c-2e0a-476f-bbb0-bfbbf03d7db2-delete_volume'" released by "delete_volume" :: held 8.528s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:16:08.597344 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] Created reservations ['2cc822e8-d5ac-4447-aa84-30bc85ce52b9', '7dd823b1-89f0-42e2-bfe1-5e293c64be58', 'ba79c99a-20e0-4b99-8815-de0041cea6ba', '564596ed-18ca-44b8-9b3c-7b17c714cd1b'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:16:08.802463 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:08.851871 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:08.915428 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:08.920053 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] Deleted volume successfully. Feb 12 21:16:08.977479 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-011bff71-ee53-4b14-af02-5678226d4ebc tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-2abea7c0-bbed-4f39-8231-884740b5d70b-delete_volume'" released by "delete_volume" :: held 6.899s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:16:09.730668 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:16:09.953139 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:10.207262 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:16:10.207769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] Volume volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:16:10.299612 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] deleting rbd volume volume-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:16:14.264603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] Created reservations ['f5fa45cb-216f-4595-9024-024f1b96f789', 'bfba12c7-0713-48d9-8836-dd7989d7f94d', 'ae5b1aa6-5670-4fb7-9c5b-a68cb896c5f3', '40c3c3f0-8d96-4627-a90f-33b99de68047'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:16:14.488196 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:14.531610 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:14.580733 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:14.594525 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] Deleted volume successfully. Feb 12 21:16:14.646909 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bfcf5bd2-e4b5-4389-bebb-61994bef1e1d tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a-delete_volume'" released by "delete_volume" :: held 4.916s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:16:15.481148 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:16:15.607338 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:15.882368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:16:16.061211 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] deleting rbd volume volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:16:20.147066 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:16:20.311551 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] deleting parent snapshot volume-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:16:22.823241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] Lock "b'cinder-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82-delete_volume'" acquired by "delete_volume" :: waited 0.070s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:16:22.929552 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] Created reservations ['cf5dfcec-86f0-4313-a310-5c6766b58509', '10e3ff7c-3479-4a90-93c3-d292bffd06ab', '96d096c8-af12-4ea9-859b-be8da4d70272', '63ed81a2-0951-4a8d-a435-b5ae346b42a4'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:16:22.955253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:23.155595 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:16:23.156397 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] Volume volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:16:23.307963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] deleting rbd volume volume-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:16:23.502649 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:23.602631 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:23.667509 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:23.677839 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] Deleted volume successfully. Feb 12 21:16:23.800313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-6ba35c08-ea1b-42e8-98f6-f21244b98d89 tempest-TaggedBootDevicesTest-172445176 None] Lock "b'cinder-6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2-delete_volume'" released by "delete_volume" :: held 8.319s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:16:27.379418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] Created reservations ['d361f546-a724-4e1f-a65e-4e1a6f55140b', '0fa7ba95-a7ca-4670-8ca8-6f79de9c547b', '7633e59c-f9fc-46a0-a311-f52c1dfab365', '551e89c1-5d40-4b07-9360-5094c75bdac2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:16:27.659163 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:27.717882 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:16:27.788095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:16:27.801796 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] Deleted volume successfully. Feb 12 21:16:27.915494 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-504a88dd-fdf0-4d66-ac6d-cb1c2b6024f0 tempest-AttachVolumeNegativeTest-377263399 None] Lock "b'cinder-e8cb03f3-163b-4e9d-bbc6-451e75bc5c82-delete_volume'" released by "delete_volume" :: held 5.089s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:17:07.187965 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:17:07.190524 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:17:07.254935 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:17:07.313731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:18:07.194319 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:18:07.195119 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:18:07.253469 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:18:07.371549 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:19:07.197706 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:19:07.199050 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:19:07.259829 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:19:07.324743 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:19:24.599835 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] Lock "b'cinder-529282b2-ffa4-43d7-8822-61c791cd9d78-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:19:24.826792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:19:25.061762 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:19:25.062659 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] Volume volume-529282b2-ffa4-43d7-8822-61c791cd9d78 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:19:25.159488 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] deleting rbd volume volume-529282b2-ffa4-43d7-8822-61c791cd9d78 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:19:28.941769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] Created reservations ['add713c2-43d8-4cb9-826f-8ff0fe72381a', '22471d17-8ccb-480d-9af3-43b8e173ba32', '7c844fbf-16f8-4097-9e05-bc9b6c290baa', 'd7e3163f-7823-4a8c-b25c-699d8bcab4b0'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:19:29.230149 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:19:29.426150 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:19:29.513462 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:19:29.517851 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] Deleted volume successfully. Feb 12 21:19:30.023117 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-18031acb-0482-4b63-8b19-b44e97b342c6 tempest-DeleteServersTestJSON-1687401015 None] Lock "b'cinder-529282b2-ffa4-43d7-8822-61c791cd9d78-delete_volume'" released by "delete_volume" :: held 5.422s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:20:07.200958 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:20:07.201691 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:07.251381 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:07.329295 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:20:35.495182 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:20:35.500570 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:20:35.501063 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:20:35.524257 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Flow 'volume_create_manager' (12d57f0a-bb1b-4c09-b3de-b2922bfd4d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:20:35.531394 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef17fcd-4be3-4154-8bb5-fe264fa9e3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:35.540857 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:20:35.556976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef17fcd-4be3-4154-8bb5-fe264fa9e3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-350907428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=adee0293-7e72-4bce-b28a-551920b15c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18c9d2744384429a268ed733f24e3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:20:35Z,use_quota=True,user_id='cc147ddb4a0e4da8b8684aefdb12a9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:35.563626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a564ab-d819-404a-a37b-f6d8eb771718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:35.568767 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a564ab-d819-404a-a37b-f6d8eb771718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:35.574180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ebffc7-d9d6-4222-ad6f-a8426199df55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:35.578810 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ebffc7-d9d6-4222-ad6f-a8426199df55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adee0293-7e72-4bce-b28a-551920b15c78', 'volume_name': 'volume-adee0293-7e72-4bce-b28a-551920b15c78', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:35.586164 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89665cdc-1c78-473a-adec-79ee09d515bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:35.590537 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89665cdc-1c78-473a-adec-79ee09d515bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:35.595702 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7feff500-9453-4042-a880-fcd2b50d2908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:35.596816 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Volume adee0293-7e72-4bce-b28a-551920b15c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adee0293-7e72-4bce-b28a-551920b15c78', 'volume_size': 1} Feb 12 21:20:35.605391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] creating volume 'volume-adee0293-7e72-4bce-b28a-551920b15c78' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:20:35.605391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:36.333056 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:20:36.333717 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:20:36.339323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7feff500-9453-4042-a880-fcd2b50d2908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adee0293-7e72-4bce-b28a-551920b15c78', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:36.359485 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6897722-d7f4-4391-9956-bd7172e2bc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:36.450014 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Volume volume-adee0293-7e72-4bce-b28a-551920b15c78 (adee0293-7e72-4bce-b28a-551920b15c78): created successfully Feb 12 21:20:36.455584 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6897722-d7f4-4391-9956-bd7172e2bc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:36.464389 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Flow 'volume_create_manager' (12d57f0a-bb1b-4c09-b3de-b2922bfd4d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:20:36.587097 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-113338ca-3645-4738-92d0-4099fb8e18af tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Created volume successfully. Feb 12 21:20:39.633729 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Lock "b'cinder-adee0293-7e72-4bce-b28a-551920b15c78-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:20:39.764986 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:40.015656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:20:40.016311 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Volume volume-adee0293-7e72-4bce-b28a-551920b15c78 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:20:40.165568 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] deleting rbd volume volume-adee0293-7e72-4bce-b28a-551920b15c78 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:20:44.068836 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Created reservations ['bd644b6c-1c6d-4601-acae-b6be2b376915', '24b03025-980c-45a4-af4c-eb739659b46f', '6a4fe9c5-16ea-4559-aef0-70021b1c72f2', '515db1ed-4a5b-4340-8e31-fc1f7e4ab700'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:20:44.285452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:44.336165 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:44.402452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:20:44.407950 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Deleted volume successfully. Feb 12 21:20:44.479141 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0c94aeef-43af-4c54-8cd3-f808a9ab317a tempest-VolumeQuotasNegativeTestJSON-1745719751 None] Lock "b'cinder-adee0293-7e72-4bce-b28a-551920b15c78-delete_volume'" released by "delete_volume" :: held 4.844s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:20:52.502326 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:20:52.506655 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:20:52.508335 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:20:52.533104 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Flow 'volume_create_manager' (ecd85cba-4f9a-499f-a029-25f8ec0d4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:20:52.541927 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c5b428-f389-41dc-b77a-974b60b0e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.557591 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:20:52.576802 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c5b428-f389-41dc-b77a-974b60b0e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-85585845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4776652-3b7a-4b3e-8749-56e170786d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dda620b49344bdaa8408d14a9e44acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:20:52Z,use_quota=True,user_id='b2f827b7e9bd4d3c9b1062b67179782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.582795 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea0fcb9-ecba-40c9-af7c-000baf048116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.587293 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea0fcb9-ecba-40c9-af7c-000baf048116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.592907 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb0a44c-3b83-4f3d-b9d5-5f51d28f3b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.598063 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb0a44c-3b83-4f3d-b9d5-5f51d28f3b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4776652-3b7a-4b3e-8749-56e170786d32', 'volume_name': 'volume-e4776652-3b7a-4b3e-8749-56e170786d32', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.604046 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58d27d6-fffd-44de-a9c4-2ed9e40c2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.608806 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58d27d6-fffd-44de-a9c4-2ed9e40c2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.615204 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfa63d3-d33d-4df6-a94f-a49c9a170f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.616415 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Volume e4776652-3b7a-4b3e-8749-56e170786d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4776652-3b7a-4b3e-8749-56e170786d32', 'volume_size': 1} Feb 12 21:20:52.616935 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] creating volume 'volume-e4776652-3b7a-4b3e-8749-56e170786d32' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:20:52.625787 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:52.731763 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:20:52.736009 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:20:52.741386 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:20:52.766433 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Flow 'volume_create_manager' (6836d9b1-bb9e-49f0-b591-55ac3dd16b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:20:52.777943 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c722ad81-2638-4809-af4f-6845594f65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.787382 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:20:52.804767 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c722ad81-2638-4809-af4f-6845594f65cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1775532742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=319029e8-22e4-4b8b-af07-a4fe535abdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc41a22c76b47678605c68d46fc9332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:20:52Z,use_quota=True,user_id='b096e715713f47d2ac7ae917c0e04768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.823388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64406199-496e-4e15-84ec-07c929c9b905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.829885 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64406199-496e-4e15-84ec-07c929c9b905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.838157 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb0fd9d-ceb3-44ac-afa3-597b89e37904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.950330 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb0fd9d-ceb3-44ac-afa3-597b89e37904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '319029e8-22e4-4b8b-af07-a4fe535abdfb', 'volume_name': 'volume-319029e8-22e4-4b8b-af07-a4fe535abdfb', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.967641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b905f7-b18e-4ab4-8373-1b237bcb16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.967641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b905f7-b18e-4ab4-8373-1b237bcb16ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:52.967641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5e0a3-4cf4-45ce-9dbf-a426e3e9314d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:52.968004 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Volume 319029e8-22e4-4b8b-af07-a4fe535abdfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-319029e8-22e4-4b8b-af07-a4fe535abdfb', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:20:52.968412 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Cloning 319029e8-22e4-4b8b-af07-a4fe535abdfb from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:20:52.981427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:20:53.133478 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 20, 52, 985479)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:20:53.133919 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:20:53.145062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:20:53.145062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.159s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:20:53.145062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:20:53.155100 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 20, 53, 146289)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:20:53.155507 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:20:53.156355 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:20:53.169961 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:20:53.471793 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] creating snapshot='volume-319029e8-22e4-4b8b-af07-a4fe535abdfb.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:20:55.585113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-319029e8-22e4-4b8b-af07-a4fe535abdfb.clone_snap' to 'volume-319029e8-22e4-4b8b-af07-a4fe535abdfb' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:20:55.598017 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:20:55.599020 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:20:55.604190 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfa63d3-d33d-4df6-a94f-a49c9a170f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4776652-3b7a-4b3e-8749-56e170786d32', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:55.611780 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71811db2-e9ff-4b8b-a48a-6fef0145f2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:55.748186 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Volume volume-e4776652-3b7a-4b3e-8749-56e170786d32 (e4776652-3b7a-4b3e-8749-56e170786d32): created successfully Feb 12 21:20:55.748186 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71811db2-e9ff-4b8b-a48a-6fef0145f2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:55.748186 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Flow 'volume_create_manager' (ecd85cba-4f9a-499f-a029-25f8ec0d4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:20:55.875762 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-058233da-c5fd-4564-87cb-ecefedc52080 tempest-AttachVolumeTestJSON-1617998511 None] Created volume successfully. Feb 12 21:20:56.935192 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:20:56.936787 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:20:56.937273 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:20:57.284057 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:20:57.285668 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Marking volume 319029e8-22e4-4b8b-af07-a4fe535abdfb as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:20:57.407078 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 319029e8-22e4-4b8b-af07-a4fe535abdfb. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:20:57.407293 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Creating volume glance metadata for volume 319029e8-22e4-4b8b-af07-a4fe535abdfb backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:20:57.638218 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5e0a3-4cf4-45ce-9dbf-a426e3e9314d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319029e8-22e4-4b8b-af07-a4fe535abdfb', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:57.648301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d03c3c-c85a-4174-8627-e82cf61a2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:20:57.759010 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Volume volume-319029e8-22e4-4b8b-af07-a4fe535abdfb (319029e8-22e4-4b8b-af07-a4fe535abdfb): created successfully Feb 12 21:20:57.762790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d03c3c-c85a-4174-8627-e82cf61a2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:20:57.769828 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Flow 'volume_create_manager' (6836d9b1-bb9e-49f0-b591-55ac3dd16b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:20:57.821833 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-835db3a6-fd00-412d-8bea-be9c769c31de req-46f8f228-7a38-418e-8087-65d8c7f5603b tempest-AttachVolumeTestJSON-1617998511 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:20:57.865623 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d806c199-d679-47cb-aa2e-cbffb6fbf5b9 tempest-VolumesExtendTest-1766878107 None] Created volume successfully. Feb 12 21:20:58.757527 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-835db3a6-fd00-412d-8bea-be9c769c31de req-46f8f228-7a38-418e-8087-65d8c7f5603b tempest-AttachVolumeTestJSON-1617998511 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.936s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:20:58.759104 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-835db3a6-fd00-412d-8bea-be9c769c31de req-46f8f228-7a38-418e-8087-65d8c7f5603b tempest-AttachVolumeTestJSON-1617998511 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e4776652-3b7a-4b3e-8749-56e170786d32', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'e4776652-3b7a-4b3e-8749-56e170786d32', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:20:58.870439 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-835db3a6-fd00-412d-8bea-be9c769c31de req-46f8f228-7a38-418e-8087-65d8c7f5603b tempest-AttachVolumeTestJSON-1617998511 None] Connection info returned from driver {'name': 'volumes/volume-e4776652-3b7a-4b3e-8749-56e170786d32', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e4776652-3b7a-4b3e-8749-56e170786d32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '253d649f-b068-4d41-8543-9a4383ceb24a'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:20:59.037123 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-835db3a6-fd00-412d-8bea-be9c769c31de req-46f8f228-7a38-418e-8087-65d8c7f5603b tempest-AttachVolumeTestJSON-1617998511 None] attachment_update completed successfully. Feb 12 21:20:59.138115 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b61fcab-6072-4b77-84c4-3e1a36538de7 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:00.499905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b61fcab-6072-4b77-84c4-3e1a36538de7 tempest-VolumesExtendTest-1766878107 None] Extend volume from 1 GB to 2 GB. {{(pid=134690) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Feb 12 21:21:00.707824 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1b61fcab-6072-4b77-84c4-3e1a36538de7 tempest-VolumesExtendTest-1766878107 None] Extend volume completed successfully. Feb 12 21:21:02.646568 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:21:02.653214 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:21:02.653818 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:21:02.681945 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Flow 'volume_create_manager' (e2398c04-c05d-4761-a5ad-0f8f117ccdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:02.692210 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec17ef6-129c-43de-bf42-0f4432e97c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:02.701773 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:21:02.747635 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec17ef6-129c-43de-bf42-0f4432e97c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1091542711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ad6b237-ecaf-4e01-926e-6247c5064032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc41a22c76b47678605c68d46fc9332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:21:02Z,use_quota=True,user_id='b096e715713f47d2ac7ae917c0e04768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:02.772826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10baaa60-69dd-48a2-88d8-0374602f0718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:02.786241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10baaa60-69dd-48a2-88d8-0374602f0718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:02.809998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95da011-366c-443b-9f58-bdb6d126a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:02.814671 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95da011-366c-443b-9f58-bdb6d126a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad6b237-ecaf-4e01-926e-6247c5064032', 'volume_name': 'volume-8ad6b237-ecaf-4e01-926e-6247c5064032', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:02.821345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b102c8ae-a4d2-40e5-ac89-e35c6996de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:02.826047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b102c8ae-a4d2-40e5-ac89-e35c6996de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:02.832923 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423ed32c-a22d-4227-b7b1-a82fb584ef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:02.834539 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Volume 8ad6b237-ecaf-4e01-926e-6247c5064032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad6b237-ecaf-4e01-926e-6247c5064032', 'volume_size': 1} Feb 12 21:21:02.835264 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] creating volume 'volume-8ad6b237-ecaf-4e01-926e-6247c5064032' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:21:02.836482 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:03.583598 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:21:03.584842 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:21:03.595811 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423ed32c-a22d-4227-b7b1-a82fb584ef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad6b237-ecaf-4e01-926e-6247c5064032', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:03.616524 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762faf99-0e2c-4178-9603-f126a0f1f169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:03.702382 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Volume volume-8ad6b237-ecaf-4e01-926e-6247c5064032 (8ad6b237-ecaf-4e01-926e-6247c5064032): created successfully Feb 12 21:21:03.706578 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762faf99-0e2c-4178-9603-f126a0f1f169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:03.718239 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Flow 'volume_create_manager' (e2398c04-c05d-4761-a5ad-0f8f117ccdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:03.867388 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5aa7277e-5945-4322-8d31-ce1cdf13f34a tempest-VolumesExtendTest-1766878107 None] Created volume successfully. Feb 12 21:21:05.455565 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64d090f4-ef29-4bce-9b67-10dca174060f tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:07.198089 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:21:07.198881 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:07.430632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:07.512405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:21:08.732794 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64d090f4-ef29-4bce-9b67-10dca174060f tempest-VolumesExtendTest-1766878107 None] Create snapshot completed successfully Feb 12 21:21:09.851948 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-052fb556-6a35-4655-a1e0-24ae18135eb2 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:11.115457 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-052fb556-6a35-4655-a1e0-24ae18135eb2 tempest-VolumesExtendTest-1766878107 None] Extend volume from 1 GB to 2 GB. {{(pid=134690) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Feb 12 21:21:11.420179 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-052fb556-6a35-4655-a1e0-24ae18135eb2 tempest-VolumesExtendTest-1766878107 None] Extend volume completed successfully. Feb 12 21:21:12.345470 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d1493bfa-ed19-4dd2-a76f-4f9347d9b902 tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-e5691a22-6425-4127-a709-7ccf2ac405f8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:21:12.358791 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d1493bfa-ed19-4dd2-a76f-4f9347d9b902 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:15.525124 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-d1493bfa-ed19-4dd2-a76f-4f9347d9b902 tempest-VolumesExtendTest-1766878107 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:21:15.668385 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d1493bfa-ed19-4dd2-a76f-4f9347d9b902 tempest-VolumesExtendTest-1766878107 None] Created reservations ['2035aa0d-978b-4f41-a2d6-dbfdf37fc4cd', '5525a3fb-8a76-4c55-a1d0-30ab4e740e88', '3fe1f2a1-612d-4644-9195-68764cd4918f', '4bbeaf96-8a9d-40a5-b1a6-8cda5d674b2f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:21:15.870397 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d1493bfa-ed19-4dd2-a76f-4f9347d9b902 tempest-VolumesExtendTest-1766878107 None] Delete snapshot completed successfully. Feb 12 21:21:15.876500 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d1493bfa-ed19-4dd2-a76f-4f9347d9b902 tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-e5691a22-6425-4127-a709-7ccf2ac405f8-delete_snapshot'" released by "delete_snapshot" :: held 3.531s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:21:16.808256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-8ad6b237-ecaf-4e01-926e-6247c5064032-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:21:16.953277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:17.176370 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:21:17.179674 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] Volume volume-8ad6b237-ecaf-4e01-926e-6247c5064032 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:21:17.369697 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] deleting rbd volume volume-8ad6b237-ecaf-4e01-926e-6247c5064032 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:21:21.215521 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] Created reservations ['fa4e6e80-3785-4676-bdb7-9c8b60cb309a', 'd3abaa93-4fd2-46f0-afca-11ccfe7d8c45', '5d9411f6-c620-45e5-9c83-5998a229d25e', 'a6d13334-478f-4a3b-98d5-5a293588bc22'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:21:21.512730 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:21.611632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:21.678491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:21:21.683042 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] Deleted volume successfully. Feb 12 21:21:21.786450 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-fb4e2d2e-b650-4c8d-b5ec-5b8cf597f09a tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-8ad6b237-ecaf-4e01-926e-6247c5064032-delete_volume'" released by "delete_volume" :: held 4.978s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:21:22.601984 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-319029e8-22e4-4b8b-af07-a4fe535abdfb-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:21:22.772582 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:22.992335 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:21:23.110460 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] deleting rbd volume volume-319029e8-22e4-4b8b-af07-a4fe535abdfb {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:21:27.313722 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:21:27.556733 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] deleting parent snapshot volume-319029e8-22e4-4b8b-af07-a4fe535abdfb.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:21:30.304429 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] Created reservations ['f06b4970-aeb5-4ee0-9eb5-2e2deb1ff551', 'ca06226c-84a2-44c3-9708-18e28e8385af', '08e6074f-da2c-4aad-bd25-2816bbab1e4a', '3d39c207-f3dc-429d-83f7-527b07418796'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:21:30.552723 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:30.634563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:30.731039 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:21:30.736230 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] Deleted volume successfully. Feb 12 21:21:30.844403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-fb995687-44f3-4ab3-8ec3-6bf570edccf0 tempest-VolumesExtendTest-1766878107 None] Lock "b'cinder-319029e8-22e4-4b8b-af07-a4fe535abdfb-delete_volume'" released by "delete_volume" :: held 8.251s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:21:41.253173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:21:41.261799 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:21:41.263493 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:21:41.316060 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Flow 'volume_create_manager' (aaa8256e-0fb6-48a7-ac24-2cad131d9b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:41.335550 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f33746d-42de-4a8a-b170-cb5d41bc10cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:41.349432 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:21:41.380442 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f33746d-42de-4a8a-b170-cb5d41bc10cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2009146160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=73bfa40f-e762-4d02-85f2-a1c0080ffc3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82441d4c279541fd8db2b834dd183bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:21:41Z,use_quota=True,user_id='74e12d46aea445f6a789e09243e05332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:41.390331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf2d50b-1b0b-4fff-b324-cb4ae25cd3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:41.396944 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf2d50b-1b0b-4fff-b324-cb4ae25cd3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:41.403133 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32aa646a-2468-431d-86a1-d765aaefcde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:41.409250 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32aa646a-2468-431d-86a1-d765aaefcde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73bfa40f-e762-4d02-85f2-a1c0080ffc3e', 'volume_name': 'volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:41.415913 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402495eb-8c2c-4c91-a72c-efbc5f010911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:41.422991 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402495eb-8c2c-4c91-a72c-efbc5f010911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:41.431208 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cad68b-743e-43cf-a827-0af0c8dc82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:41.432593 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Volume 73bfa40f-e762-4d02-85f2-a1c0080ffc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e', 'volume_size': 1} Feb 12 21:21:41.433191 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] creating volume 'volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:21:41.434680 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:42.049848 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:21:42.050231 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:21:42.054047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cad68b-743e-43cf-a827-0af0c8dc82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:42.061329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d523699-a728-4ee9-a1fe-ee18379f7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:42.143619 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Volume volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e (73bfa40f-e762-4d02-85f2-a1c0080ffc3e): created successfully Feb 12 21:21:42.148837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d523699-a728-4ee9-a1fe-ee18379f7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:42.154919 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Flow 'volume_create_manager' (aaa8256e-0fb6-48a7-ac24-2cad131d9b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:42.232010 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3a979f8a-3d8e-44c1-9c16-8dafb5dee064 tempest-VolumesListTestJSON-2040808196 None] Created volume successfully. Feb 12 21:21:44.272024 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:21:44.275482 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:21:44.279843 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:21:44.298895 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Flow 'volume_create_manager' (19ffb21b-4766-40c5-830d-0a5fed66491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:44.318595 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afb179d-1e1f-4c5c-bef1-d2a5a95aa1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:44.330059 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:21:44.347842 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afb179d-1e1f-4c5c-bef1-d2a5a95aa1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-312503753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03bfb1dc-c8b1-453a-939f-b91d46da95b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82441d4c279541fd8db2b834dd183bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:21:44Z,use_quota=True,user_id='74e12d46aea445f6a789e09243e05332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:44.354372 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62bdfda-2d2b-42d9-a24b-fefc90090238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:44.359481 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62bdfda-2d2b-42d9-a24b-fefc90090238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:44.366636 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f17e05-c67d-435c-b3b2-f8cdcda28dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:44.371113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f17e05-c67d-435c-b3b2-f8cdcda28dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03bfb1dc-c8b1-453a-939f-b91d46da95b6', 'volume_name': 'volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:44.376803 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040aa324-0201-4943-80c6-aff2f5310c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:44.381630 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040aa324-0201-4943-80c6-aff2f5310c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:44.390031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a750bb26-041e-4066-a5f4-d7dc6d3d94ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:44.390031 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Volume 03bfb1dc-c8b1-453a-939f-b91d46da95b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6', 'volume_size': 1} Feb 12 21:21:44.390031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] creating volume 'volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:21:44.390998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:45.060027 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:21:45.060411 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:21:45.064222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a750bb26-041e-4066-a5f4-d7dc6d3d94ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:45.073256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15f46f-466b-403a-b436-f5b8936e15de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:45.217722 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Volume volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6 (03bfb1dc-c8b1-453a-939f-b91d46da95b6): created successfully Feb 12 21:21:45.221837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15f46f-466b-403a-b436-f5b8936e15de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:45.232876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Flow 'volume_create_manager' (19ffb21b-4766-40c5-830d-0a5fed66491d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:45.319525 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e7770f67-752a-4e3f-bf89-8def42201514 tempest-VolumesListTestJSON-2040808196 None] Created volume successfully. Feb 12 21:21:47.288432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:21:47.291825 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:21:47.295502 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:21:47.325016 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Flow 'volume_create_manager' (22a515fe-c2e7-47a6-afb1-194e6503dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:47.333312 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4a523e-6e06-44ed-8f04-5e2b8130df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:47.340233 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:21:47.357183 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4a523e-6e06-44ed-8f04-5e2b8130df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1592878501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3830f416-d2fe-4dac-9b62-826e01a94b14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82441d4c279541fd8db2b834dd183bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:21:47Z,use_quota=True,user_id='74e12d46aea445f6a789e09243e05332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:47.363928 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad732e3-3e2a-4380-9f31-3478eaf48ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:47.368530 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad732e3-3e2a-4380-9f31-3478eaf48ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:47.373956 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079498ca-b47f-4624-8a29-9437673ed5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:47.379611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (079498ca-b47f-4624-8a29-9437673ed5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3830f416-d2fe-4dac-9b62-826e01a94b14', 'volume_name': 'volume-3830f416-d2fe-4dac-9b62-826e01a94b14', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:47.385755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ad1fcb-5c3e-4cf3-a5c0-d0c1373b53ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:47.390934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ad1fcb-5c3e-4cf3-a5c0-d0c1373b53ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:47.397403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b96e89d-90bb-4160-addb-49220bba7ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:47.398903 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Volume 3830f416-d2fe-4dac-9b62-826e01a94b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3830f416-d2fe-4dac-9b62-826e01a94b14', 'volume_size': 1} Feb 12 21:21:47.399456 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] creating volume 'volume-3830f416-d2fe-4dac-9b62-826e01a94b14' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:21:47.401649 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:48.315828 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:21:48.316998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:21:48.321743 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b96e89d-90bb-4160-addb-49220bba7ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3830f416-d2fe-4dac-9b62-826e01a94b14', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:48.326966 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4a0aa8-ec6b-492b-b324-9a7b88d97628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:21:48.531992 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Volume volume-3830f416-d2fe-4dac-9b62-826e01a94b14 (3830f416-d2fe-4dac-9b62-826e01a94b14): created successfully Feb 12 21:21:48.537555 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4a0aa8-ec6b-492b-b324-9a7b88d97628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:21:48.544042 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Flow 'volume_create_manager' (22a515fe-c2e7-47a6-afb1-194e6503dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:21:48.617818 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b2748823-2e41-42f0-9b0c-efb2089f4dec tempest-VolumesListTestJSON-2040808196 None] Created volume successfully. Feb 12 21:21:53.053255 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] Lock "b'cinder-3830f416-d2fe-4dac-9b62-826e01a94b14-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:21:53.191267 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:53.400139 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:21:53.400986 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] Volume volume-3830f416-d2fe-4dac-9b62-826e01a94b14 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:21:53.513698 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] deleting rbd volume volume-3830f416-d2fe-4dac-9b62-826e01a94b14 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:21:57.351158 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] Created reservations ['8d60a0fa-2e5e-45fc-bcbf-e35d6d131eb8', '257af756-2f6f-4b74-8943-71895e601955', '2d209bc6-86ee-4a1c-a08b-de9d013d25fc', 'f8437d59-87ec-4aca-ac17-4c7552b755a2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:21:57.573581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:57.623555 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:57.740025 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:21:57.744526 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] Deleted volume successfully. Feb 12 21:21:57.865226 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-944162de-be18-4fd8-a8b2-a6450f5a3a6a tempest-VolumesListTestJSON-2040808196 None] Lock "b'cinder-3830f416-d2fe-4dac-9b62-826e01a94b14-delete_volume'" released by "delete_volume" :: held 4.812s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:21:58.707567 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] Lock "b'cinder-03bfb1dc-c8b1-453a-939f-b91d46da95b6-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:21:58.807967 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:21:59.011333 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:21:59.011816 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] Volume volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:21:59.103212 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] deleting rbd volume volume-03bfb1dc-c8b1-453a-939f-b91d46da95b6 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:22:00.684093 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-25397b95-b884-4d31-ba73-64452aec508b req-3e5af6db-7fe3-4391-8d4c-93887653be26 tempest-AttachVolumeTestJSON-1617998511 None] Terminate volume connection completed successfully. Feb 12 21:22:00.684791 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-25397b95-b884-4d31-ba73-64452aec508b req-3e5af6db-7fe3-4391-8d4c-93887653be26 tempest-AttachVolumeTestJSON-1617998511 None] Deleting attachment 253d649f-b068-4d41-8543-9a4383ceb24a. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:22:03.599769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] Created reservations ['33a8eda1-1ca5-4f3c-86da-e93d0b442ebe', '5e78cacd-469b-44fd-ac03-9d83459ca3cc', 'b2d957bc-7dbc-471e-83a9-a0822bf6dd7f', 'a7910731-7086-48d1-94fd-beaf38d19a1d'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:22:03.827605 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:03.895600 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:03.939165 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:22:03.949292 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] Deleted volume successfully. Feb 12 21:22:04.024908 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5e51ff62-eebd-4114-9d7e-cd48bad50fce tempest-VolumesListTestJSON-2040808196 None] Lock "b'cinder-03bfb1dc-c8b1-453a-939f-b91d46da95b6-delete_volume'" released by "delete_volume" :: held 5.316s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:22:04.411026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] Lock "b'cinder-73bfa40f-e762-4d02-85f2-a1c0080ffc3e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:22:04.524759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:04.683633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:22:04.684245 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] Volume volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:22:04.804653 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] deleting rbd volume volume-73bfa40f-e762-4d02-85f2-a1c0080ffc3e {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:22:07.204412 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:22:07.205648 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:07.243782 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:07.275100 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:22:08.611403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] Created reservations ['bd883757-4f42-44f1-9516-f1da9d19cf0b', '47686ae6-5ebf-4f12-9705-7ce69d754256', 'b8d63ec1-c404-4cfb-aac0-df1c23a0662d', '6c1b3e25-3970-4c27-9027-c3f961f99809'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:22:08.874169 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:08.936731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:09.010721 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:22:09.016019 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] Deleted volume successfully. Feb 12 21:22:09.155256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8c229271-cefb-4001-9f2c-5d6534169e4a tempest-VolumesListTestJSON-2040808196 None] Lock "b'cinder-73bfa40f-e762-4d02-85f2-a1c0080ffc3e-delete_volume'" released by "delete_volume" :: held 4.742s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:22:17.618353 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:22:17.627271 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:22:17.627271 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:22:17.652019 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (61b90613-1d7f-46ca-bc80-0c76c5cb1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:22:17.667845 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24339cf7-94c6-4976-9c2b-48cbfb2be4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:22:17.690274 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:22:17.714938 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24339cf7-94c6-4976-9c2b-48cbfb2be4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1220384451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d0f4abb-5903-44b8-87d3-462cd29d1ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07de9e87ea3f495f90baaf85d83b982c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:22:17Z,use_quota=True,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:22:17.720682 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc52561-2303-4b95-9e54-afdd4c2db88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:22:17.739305 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc52561-2303-4b95-9e54-afdd4c2db88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:22:17.744607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cbda4f-6e46-45a1-b532-cc49b79d2ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:22:17.748932 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cbda4f-6e46-45a1-b532-cc49b79d2ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'volume_name': 'volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:22:17.768248 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6646bfea-890b-4bca-bea5-0b80d12de959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:22:17.772424 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6646bfea-890b-4bca-bea5-0b80d12de959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:22:17.780331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9039a07a-7c51-4e6b-af8e-0b0933471a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:22:17.781384 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume 3d0f4abb-5903-44b8-87d3-462cd29d1ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'volume_size': 1} Feb 12 21:22:17.781888 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] creating volume 'volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:22:17.783042 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:18.284396 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:22:18.286542 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:22:18.295784 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9039a07a-7c51-4e6b-af8e-0b0933471a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:22:18.312725 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e365f1-e610-4ac3-a956-bf4050993c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:22:18.397407 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe (3d0f4abb-5903-44b8-87d3-462cd29d1ffe): created successfully Feb 12 21:22:18.403515 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e365f1-e610-4ac3-a956-bf4050993c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:22:18.410843 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (61b90613-1d7f-46ca-bc80-0c76c5cb1506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:22:18.542811 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-62fc4cb9-4851-4948-9d8a-cc072af4cc46 tempest-VolumesSnapshotTestJSON-1959179807 None] Created volume successfully. Feb 12 21:22:20.189231 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-525359d8-0547-46ea-8219-7965b689fc8a tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:22.683145 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-525359d8-0547-46ea-8219-7965b689fc8a tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:22:24.247049 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.driver [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Creating a new backup for volume volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe. {{(pid=134690) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}} Feb 12 21:22:24.415599 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] cloning volumes/volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe@snapshot-0e2af5f2-6f44-4382-996b-59776a0542b3 to volume-f155360d-3204-4c16-b0a4-b1db32a53963 {{(pid=134690) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 12 21:22:24.416618 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:24.514136 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:25.691706 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:22:25.697123 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:22:25.714914 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:22:25.828799 ncdv-master-1 cinder-volume[134690]: WARNING cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Feb 12 21:22:26.029452 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:22:23Z,data_timestamp=2022-02-12T21:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1611843752',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cd2d6562-6afb-4796-a7ce-726fdb6ebb68,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='07de9e87ea3f495f90baaf85d83b982c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='0e2af5f2-6f44-4382-996b-59776a0542b3',status='creating',temp_snapshot_id=None,temp_volume_id='f155360d-3204-4c16-b0a4-b1db32a53963',updated_at=None,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_id=3d0f4abb-5903-44b8-87d3-462cd29d1ffe) Feb 12 21:22:26.030636 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] continue_backup in rpcapi backup_id cd2d6562-6afb-4796-a7ce-726fdb6ebb68 {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:22:32.389724 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:22:33.502781 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.113s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:22:33.504513 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f155360d-3204-4c16-b0a4-b1db32a53963', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'f155360d-3204-4c16-b0a4-b1db32a53963', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:22:33.560514 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Initialize volume connection completed successfully. Feb 12 21:23:00.297427 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8052c5ea-abc9-4db7-9ef8-143fe9b6c34a tempest-GroupsV314Test-802431919 None] Group tempest-GroupsV314Test-Group-539479908: creating Feb 12 21:23:00.438839 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8052c5ea-abc9-4db7-9ef8-143fe9b6c34a tempest-GroupsV314Test-802431919 None] Group tempest-GroupsV314Test-Group-539479908: created successfully Feb 12 21:23:00.452415 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8052c5ea-abc9-4db7-9ef8-143fe9b6c34a tempest-GroupsV314Test-802431919 None] Create group completed successfully. Feb 12 21:23:02.831973 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:23:02.836433 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:23:02.839910 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:23:02.893839 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Flow 'volume_create_manager' (d00da4eb-fb7a-457b-bda2-62adb25886b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:02.912954 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1151baaa-d6f1-48b0-9fd8-e33d133a3d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:02.924779 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:23:02.959140 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1151baaa-d6f1-48b0-9fd8-e33d133a3d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1140863515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c68e423e-811c-4d33-80ff-54e6acdf4638,host='ncdv-master-1@ceph#ceph',id=6a06391d-b24c-479b-b19d-54f2f2e7dd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031bb25aa2854625b282d62dc6695e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:23:03Z,use_quota=True,user_id='65b335468ebf41e1a9b69fb3ea6d62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b6c4238-ab1a-4186-8cdd-6caa80d4ff3a),volume_type_id=0b6c4238-ab1a-4186-8cdd-6caa80d4ff3a)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:02.978112 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c71abef-cea6-45d3-9fb3-3dae9a6a745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:02.990413 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c71abef-cea6-45d3-9fb3-3dae9a6a745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:02.997567 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e368c7ae-0a8e-4d67-a925-168102ea0f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:03.004159 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e368c7ae-0a8e-4d67-a925-168102ea0f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a06391d-b24c-479b-b19d-54f2f2e7dd1d', 'volume_name': 'volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:03.010891 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ca8390-e835-4458-aec6-f0b0de3b2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:03.017646 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ca8390-e835-4458-aec6-f0b0de3b2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:03.026178 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc23e2cd-91d3-4711-86fb-1dfde063aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:03.028454 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Volume 6a06391d-b24c-479b-b19d-54f2f2e7dd1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d', 'volume_size': 1} Feb 12 21:23:03.029130 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] creating volume 'volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:23:03.030533 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:04.871948 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:23:04.871948 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:23:04.871948 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc23e2cd-91d3-4711-86fb-1dfde063aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:04.871948 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f2f52d-7456-4f90-bb1b-76da618902fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:04.970602 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Volume volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d (6a06391d-b24c-479b-b19d-54f2f2e7dd1d): created successfully Feb 12 21:23:04.988570 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f2f52d-7456-4f90-bb1b-76da618902fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:04.996416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Flow 'volume_create_manager' (d00da4eb-fb7a-457b-bda2-62adb25886b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:05.072539 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e3adec6d-951e-4e26-bd15-b73106f80d0c tempest-GroupsV314Test-802431919 None] Created volume successfully. Feb 12 21:23:07.151220 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:08.259595 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] creating snapshot='volume-ed62ed0a-8f47-43f8-bbbd-36d2bec299e5.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:23:10.644678 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] cloning 'volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d@volume-ed62ed0a-8f47-43f8-bbbd-36d2bec299e5.clone_snap' to 'volume-ed62ed0a-8f47-43f8-bbbd-36d2bec299e5' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:23:10.659511 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:23:10.659511 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:10.831903 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:10.895817 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:23:11.199522 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:23:11.199522 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:23:11.199522 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:23:11.225856 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Flow 'volume_create_manager' (acd3da1b-64b3-4e28-ae4f-aa5b843fa1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:11.235074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfe4e87-14d8-4843-969a-92da2f59a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:11.243417 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:23:11.272638 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfe4e87-14d8-4843-969a-92da2f59a15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-430221098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=132dabd2-a864-4525-9a31-66d563ade93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5555b2867cc4486fafac4efab11275c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:23:07Z,use_quota=True,user_id='2f37062203da4a4d99d7ef9585c74939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:11.278943 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4adff9-a0ed-41fb-9564-425e51ead769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:11.283951 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4adff9-a0ed-41fb-9564-425e51ead769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:11.290409 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ea6cc-b43d-4bbc-a253-0d0bca98ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:11.295427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ea6cc-b43d-4bbc-a253-0d0bca98ba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132dabd2-a864-4525-9a31-66d563ade93d', 'volume_name': 'volume-132dabd2-a864-4525-9a31-66d563ade93d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:11.302055 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b2518e-fa4b-411e-9463-4b2206d5292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:11.307212 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b2518e-fa4b-411e-9463-4b2206d5292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:11.320680 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ace3597-cbdf-48cf-b9ae-757cc8b9e0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:11.322171 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Volume 132dabd2-a864-4525-9a31-66d563ade93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132dabd2-a864-4525-9a31-66d563ade93d', 'volume_size': 1} Feb 12 21:23:11.322711 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] creating volume 'volume-132dabd2-a864-4525-9a31-66d563ade93d' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:23:11.324113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:13.403832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:23:13.403832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:23:13.408331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ace3597-cbdf-48cf-b9ae-757cc8b9e0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132dabd2-a864-4525-9a31-66d563ade93d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:13.415176 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6126cec1-aac2-483f-87a0-b7fd6f6f5300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:13.519112 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Volume volume-132dabd2-a864-4525-9a31-66d563ade93d (132dabd2-a864-4525-9a31-66d563ade93d): created successfully Feb 12 21:23:13.526128 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6126cec1-aac2-483f-87a0-b7fd6f6f5300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:13.535883 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Flow 'volume_create_manager' (acd3da1b-64b3-4e28-ae4f-aa5b843fa1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:13.650538 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 req-2d7bba5d-50e5-48b6-9be9-2cb30d541720 tempest-VolumesSnapshotsTestJSON-342743143 None] Created volume successfully. Feb 12 21:23:14.521388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] Volume volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:23:14.528155 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:23:14.530251 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:23:16.180344 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:23:16.420673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-5a4e3d3d-7191-4804-b5f5-d006bf0c6e0b req-d091f936-d4be-496b-a292-b71acc3cf5a5 tempest-VolumesSnapshotsTestJSON-342743143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:17.244689 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3ff957c9-73ff-4daf-a990-03e5106cfd97 tempest-GroupsV314Test-802431919 None] Create group from source-group-c68e423e-811c-4d33-80ff-54e6acdf4638 completed successfully. Feb 12 21:23:18.435317 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:18.729865 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:23:19.060431 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] deleting rbd volume volume-ed62ed0a-8f47-43f8-bbbd-36d2bec299e5 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:23:22.930443 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-5a4e3d3d-7191-4804-b5f5-d006bf0c6e0b req-d091f936-d4be-496b-a292-b71acc3cf5a5 tempest-VolumesSnapshotsTestJSON-342743143 None] Create snapshot completed successfully Feb 12 21:23:23.794736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 req-88a5a7e2-abbd-4d3c-9a9c-2ec2efec89d0 tempest-VolumesSnapshotsTestJSON-342743143 None] Lock "b'cinder-5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:23:23.796885 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 req-88a5a7e2-abbd-4d3c-9a9c-2ec2efec89d0 tempest-VolumesSnapshotsTestJSON-342743143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:25.731405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:23:25.741109 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:23:25.745319 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:23:25.796228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Flow 'volume_create_manager' (fd2f3394-69c8-4e7d-be80-ef7051635e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:25.809686 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48b9613-d9b2-4ddd-9a97-b37d4694c8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:25.828500 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:23:25.865325 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48b9613-d9b2-4ddd-9a97-b37d4694c8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1867201679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5fd3ab2d-19da-4502-a2c8-54bdbfdda994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dda620b49344bdaa8408d14a9e44acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:23:25Z,use_quota=True,user_id='b2f827b7e9bd4d3c9b1062b67179782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:25.873188 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a9bb83-e3a6-4dea-ad7e-b90a58c77e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:25.879461 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a9bb83-e3a6-4dea-ad7e-b90a58c77e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:25.886307 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe66fb3-6e15-479e-9b0d-8a37a6bb659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:25.900600 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe66fb3-6e15-479e-9b0d-8a37a6bb659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'volume_name': 'volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:25.921902 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55226f89-2c47-40d6-97bc-1f279542c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:25.949400 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55226f89-2c47-40d6-97bc-1f279542c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:25.965081 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee1972d-7549-453b-8102-d6b9d8d790ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:25.969756 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Volume 5fd3ab2d-19da-4502-a2c8-54bdbfdda994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'volume_size': 1} Feb 12 21:23:25.971894 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] creating volume 'volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:23:25.976358 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:27.117778 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:23:27.118971 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:23:27.122965 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee1972d-7549-453b-8102-d6b9d8d790ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:27.127918 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d34b83b-d49a-4760-965d-8d56b70805ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:27.240299 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Volume volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994 (5fd3ab2d-19da-4502-a2c8-54bdbfdda994): created successfully Feb 12 21:23:27.265671 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d34b83b-d49a-4760-965d-8d56b70805ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:27.278947 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Flow 'volume_create_manager' (fd2f3394-69c8-4e7d-be80-ef7051635e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:27.379123 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0daf9e80-4146-4601-8299-80f6f892a28b tempest-AttachVolumeTestJSON-1617998511 None] Created volume successfully. Feb 12 21:23:28.892067 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-25431f0e-b083-4a5b-a3ec-627fbdd2350b req-535944d6-dad1-469b-8636-2743978583f6 tempest-AttachVolumeTestJSON-1617998511 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:23:29.934248 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-25431f0e-b083-4a5b-a3ec-627fbdd2350b req-535944d6-dad1-469b-8636-2743978583f6 tempest-AttachVolumeTestJSON-1617998511 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.042s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:23:29.935121 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-25431f0e-b083-4a5b-a3ec-627fbdd2350b req-535944d6-dad1-469b-8636-2743978583f6 tempest-AttachVolumeTestJSON-1617998511 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:23:30.073084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-25431f0e-b083-4a5b-a3ec-627fbdd2350b req-535944d6-dad1-469b-8636-2743978583f6 tempest-AttachVolumeTestJSON-1617998511 None] Connection info returned from driver {'name': 'volumes/volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5fd3ab2d-19da-4502-a2c8-54bdbfdda994', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '666c2d6f-1448-41b5-a511-0c33b5f8c6ec'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:23:30.240576 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 req-88a5a7e2-abbd-4d3c-9a9c-2ec2efec89d0 tempest-VolumesSnapshotsTestJSON-342743143 None] Created reservations ['da2c8dd6-7047-4676-81a3-9c4d5479c66c', 'a613a4cd-8734-4207-b99e-8514c2b8cbd1', '96b73749-c9e1-4789-a884-f221d81d356e', '30b7d865-e06f-4bcf-9ad7-6c64b47c27c7'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:23:30.285210 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-25431f0e-b083-4a5b-a3ec-627fbdd2350b req-535944d6-dad1-469b-8636-2743978583f6 tempest-AttachVolumeTestJSON-1617998511 None] attachment_update completed successfully. Feb 12 21:23:30.495792 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 req-88a5a7e2-abbd-4d3c-9a9c-2ec2efec89d0 tempest-VolumesSnapshotsTestJSON-342743143 None] Delete snapshot completed successfully. Feb 12 21:23:30.507277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 req-88a5a7e2-abbd-4d3c-9a9c-2ec2efec89d0 tempest-VolumesSnapshotsTestJSON-342743143 None] Lock "b'cinder-5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab-delete_snapshot'" released by "delete_snapshot" :: held 6.713s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:23:31.030836 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] Lock "b'cinder-132dabd2-a864-4525-9a31-66d563ade93d-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:23:31.286609 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:31.723408 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:23:31.724026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] Volume volume-132dabd2-a864-4525-9a31-66d563ade93d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:23:32.013190 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] deleting rbd volume volume-132dabd2-a864-4525-9a31-66d563ade93d {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:23:34.086056 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:23:34.350594 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Volume volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:23:34.352865 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] deleting parent snapshot volume-ed62ed0a-8f47-43f8-bbbd-36d2bec299e5.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:23:39.606908 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:23:39.611235 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:23:39.611696 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:23:39.637468 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Flow 'volume_create_manager' (c13a6ea2-eedf-4441-a581-6da8a3f46f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:39.646731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17665f60-b0f6-4bc3-a126-b84e91321163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:39.656023 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:23:39.671742 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17665f60-b0f6-4bc3-a126-b84e91321163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1593927675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbcb87d0-7039-4000-860e-900ca1b07f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dda620b49344bdaa8408d14a9e44acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:23:36Z,use_quota=True,user_id='b2f827b7e9bd4d3c9b1062b67179782d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:39.677584 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6ff599-dbde-4aee-9130-93651e196544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:39.682278 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6ff599-dbde-4aee-9130-93651e196544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:39.688368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6649953e-7c47-4df0-8728-b7a5062f9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:39.695052 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6649953e-7c47-4df0-8728-b7a5062f9dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcb87d0-7039-4000-860e-900ca1b07f9d', 'volume_name': 'volume-dbcb87d0-7039-4000-860e-900ca1b07f9d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:39.703741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0924f736-1c42-49a4-b0d9-6c8783e03144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:39.711927 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0924f736-1c42-49a4-b0d9-6c8783e03144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:39.718465 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d768149-a5e4-4f78-aaf5-61e580893718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:39.719807 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Volume dbcb87d0-7039-4000-860e-900ca1b07f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcb87d0-7039-4000-860e-900ca1b07f9d', 'volume_size': 1} Feb 12 21:23:39.722555 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] creating volume 'volume-dbcb87d0-7039-4000-860e-900ca1b07f9d' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:23:39.723607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:39.866956 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Created reservations ['718d3938-68da-41bf-8e34-d75681bc2125'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:23:39.891307 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-988729413 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-988729413, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:23:39.893018 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-988729413 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-988729413, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:23:40.021063 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Created reservations ['844f81e5-5777-4ff9-92ed-cdde16790d19', '11952c85-687a-49a0-8b33-73a64b3fc8ae', '90eac4ef-1516-43e2-a1bb-fe60aa606849', '22705c47-0c50-439a-83ac-0498abc7238e'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:23:40.521605 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:40.562068 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:40.617209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:23:40.621322 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da0d6f5a-0486-4d0c-9c1b-2c72815c7d6e tempest-GroupsV314Test-802431919 None] Delete group completed successfully. Feb 12 21:23:41.461976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:42.368627 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:23:42.369184 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] Volume volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:23:42.672812 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] deleting rbd volume volume-6a06391d-b24c-479b-b19d-54f2f2e7dd1d {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:23:42.683909 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:23:42.687655 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:23:42.688460 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d768149-a5e4-4f78-aaf5-61e580893718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcb87d0-7039-4000-860e-900ca1b07f9d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:42.696404 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf885570-f4c3-4993-8a80-97fcfe046cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:42.775518 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Volume volume-dbcb87d0-7039-4000-860e-900ca1b07f9d (dbcb87d0-7039-4000-860e-900ca1b07f9d): created successfully Feb 12 21:23:42.780972 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf885570-f4c3-4993-8a80-97fcfe046cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:42.788221 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Flow 'volume_create_manager' (c13a6ea2-eedf-4441-a581-6da8a3f46f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:42.871738 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] Created reservations ['90f494f7-1ff6-4db8-a8b2-c0986b9f2b90', 'ae061e81-b36c-435c-b4c4-3b3b84bae52a', 'db5babf2-30c7-450d-bc87-c7907beb2f22', 'e6f9b878-c41b-4a2e-9e9d-21785865d892'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:23:42.895053 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-274e68fb-7632-40c0-8fd7-353eed09c92e tempest-AttachVolumeTestJSON-1617998511 None] Created volume successfully. Feb 12 21:23:43.072764 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:43.096838 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:43.173165 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:23:43.184962 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] Deleted volume successfully. Feb 12 21:23:43.284034 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-b35ef887-f124-4d79-9b1b-784e1a777903 req-d96cee99-6528-460a-b014-3ac255d37329 tempest-VolumesSnapshotsTestJSON-342743143 None] Lock "b'cinder-132dabd2-a864-4525-9a31-66d563ade93d-delete_volume'" released by "delete_volume" :: held 12.253s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:23:44.901217 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-fcc9dddf-942a-4a84-b6b5-539ce04f249e req-80ede520-62cc-4079-9766-731c7acdfef0 tempest-AttachVolumeTestJSON-1617998511 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:23:45.665309 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-fcc9dddf-942a-4a84-b6b5-539ce04f249e req-80ede520-62cc-4079-9766-731c7acdfef0 tempest-AttachVolumeTestJSON-1617998511 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.764s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:23:45.666335 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-fcc9dddf-942a-4a84-b6b5-539ce04f249e req-80ede520-62cc-4079-9766-731c7acdfef0 tempest-AttachVolumeTestJSON-1617998511 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dbcb87d0-7039-4000-860e-900ca1b07f9d', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'dbcb87d0-7039-4000-860e-900ca1b07f9d', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:23:45.848302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-fcc9dddf-942a-4a84-b6b5-539ce04f249e req-80ede520-62cc-4079-9766-731c7acdfef0 tempest-AttachVolumeTestJSON-1617998511 None] Connection info returned from driver {'name': 'volumes/volume-dbcb87d0-7039-4000-860e-900ca1b07f9d', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dbcb87d0-7039-4000-860e-900ca1b07f9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7651511d-bbc6-4f5e-bdd8-0122a75e3d7a'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:23:46.001325 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-fcc9dddf-942a-4a84-b6b5-539ce04f249e req-80ede520-62cc-4079-9766-731c7acdfef0 tempest-AttachVolumeTestJSON-1617998511 None] attachment_update completed successfully. Feb 12 21:23:48.799409 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:23:48.804733 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:23:48.805238 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:23:48.845481 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Flow 'volume_create_manager' (ed9efc54-f610-4afb-ab7a-96115da0e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:48.865437 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dede51f1-3d77-40ca-9382-61a08866aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:48.881181 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:23:48.901897 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dede51f1-3d77-40ca-9382-61a08866aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-279508129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6878bfe-9b60-48d8-b3cc-077d51327ca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='17c5a5fce2b642edaa3abeaa6e812ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:23:49Z,use_quota=True,user_id='e2f95057cb824cd98fe3a7a84d97893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:48.908709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a1c835-2945-415f-8d2c-8df8c184cab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:48.913886 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a1c835-2945-415f-8d2c-8df8c184cab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:48.919274 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62c448a-d5a8-44be-b68e-80b27fa8a589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:48.925797 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62c448a-d5a8-44be-b68e-80b27fa8a589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6878bfe-9b60-48d8-b3cc-077d51327ca2', 'volume_name': 'volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:48.931917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191a1a99-68e5-4748-afa8-8ff493684cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:48.936485 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191a1a99-68e5-4748-afa8-8ff493684cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:48.942108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ccaedb-711d-4cad-b0ca-8848d4550350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:48.943243 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Volume e6878bfe-9b60-48d8-b3cc-077d51327ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2', 'volume_size': 1} Feb 12 21:23:48.943826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] creating volume 'volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:23:48.945371 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:50.139169 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:23:50.140308 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:23:50.145756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ccaedb-711d-4cad-b0ca-8848d4550350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:50.169853 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c387a120-1e5f-440d-8cd8-b13208f6295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:23:50.277979 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Volume volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2 (e6878bfe-9b60-48d8-b3cc-077d51327ca2): created successfully Feb 12 21:23:50.282155 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c387a120-1e5f-440d-8cd8-b13208f6295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:23:50.301297 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Flow 'volume_create_manager' (ed9efc54-f610-4afb-ab7a-96115da0e694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:23:50.467090 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 req-7e1d36da-b4d8-48a3-b5d1-e5cbc80fa338 tempest-VolumesGetTestJSON-426322536 None] Created volume successfully. Feb 12 21:23:51.084728 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] Lock "b'cinder-e6878bfe-9b60-48d8-b3cc-077d51327ca2-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:23:51.229788 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:51.980392 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:23:51.980839 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] Volume volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:23:52.410359 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] deleting rbd volume volume-e6878bfe-9b60-48d8-b3cc-077d51327ca2 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:23:54.570563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] Created reservations ['8c32295f-3a26-4c34-aaa3-d6af5dca5803'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:23:54.706440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] Created reservations ['c0069d43-8ee0-4041-b1b7-1fa3807fead3', '25748b18-f217-4e3a-939b-ca1b03aa4811', '4f92c5fe-0143-4733-a1f9-b7be70fd0fea', '2f2e747b-c4e4-491e-879f-a3e5570fe3d3'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:23:55.168969 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:55.248988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:23:55.353990 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:23:55.358955 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0d9fe82f-0010-406b-ba71-149cac0191d3 tempest-GroupsV314Test-802431919 None] Delete group completed successfully. Feb 12 21:23:57.619299 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-6448b2a7-95e7-4133-88a9-6ade32df5525 req-ceb383ff-ac42-4d53-a321-b55df7847f59 tempest-AttachVolumeTestJSON-1617998511 None] Terminate volume connection completed successfully. Feb 12 21:23:57.620864 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-6448b2a7-95e7-4133-88a9-6ade32df5525 req-ceb383ff-ac42-4d53-a321-b55df7847f59 tempest-AttachVolumeTestJSON-1617998511 None] Deleting attachment 666c2d6f-1448-41b5-a511-0c33b5f8c6ec. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:23:59.155611 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 req-60626119-68d4-4070-822a-57dc0535bba5 tempest-AttachVolumeTestJSON-1617998511 None] Terminate volume connection completed successfully. Feb 12 21:23:59.156245 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 req-60626119-68d4-4070-822a-57dc0535bba5 tempest-AttachVolumeTestJSON-1617998511 None] Deleting attachment 7651511d-bbc6-4f5e-bdd8-0122a75e3d7a. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:24:01.369581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] Created reservations ['8fefc550-ce36-43b7-acb7-cc6adce5f5ce', 'b5f48f17-8970-4767-b1f0-c2645e46811f', 'ce400225-b014-45dc-a172-e27f651d60fc', 'bba009db-032d-4096-809e-e649f9261e3f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:01.708023 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:01.773918 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:01.834784 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:01.839425 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] Deleted volume successfully. Feb 12 21:24:02.013887 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-8c28757f-4dc3-41f5-989c-4d451dccbc02 req-c7753c71-72b4-41cf-8053-ab2e8a416db8 tempest-VolumesGetTestJSON-426322536 None] Lock "b'cinder-e6878bfe-9b60-48d8-b3cc-077d51327ca2-delete_volume'" released by "delete_volume" :: held 10.929s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:10.646521 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:24:10.647213 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:10.742831 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:10.813560 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:11.642477 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] Lock "b'cinder-dbcb87d0-7039-4000-860e-900ca1b07f9d-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:11.947720 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:12.409942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:24:12.410521 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] Volume volume-dbcb87d0-7039-4000-860e-900ca1b07f9d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:24:12.617054 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] deleting rbd volume volume-dbcb87d0-7039-4000-860e-900ca1b07f9d {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:24:13.918660 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Terminate volume connection completed successfully. Feb 12 21:24:13.987638 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Remove volume export completed successfully. Feb 12 21:24:14.104877 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-f155360d-3204-4c16-b0a4-b1db32a53963-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:14.143241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:14.510769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:24:14.741829 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-f155360d-3204-4c16-b0a4-b1db32a53963 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:24:19.168067 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:24:19.176117 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:24:19.181090 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:24:19.240903 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Flow 'volume_create_manager' (4d0e081c-4d8f-4df9-b6d0-06cfd91740be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:19.258378 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7111ed50-9191-44b8-af04-2d605e39ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:19.278217 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:24:19.317007 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7111ed50-9191-44b8-af04-2d605e39ab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1699876090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=50d3ea70-7fc3-4c0b-8f91-c944a52e53fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3e72a25d074da08cd38eb7eba08098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:24:19Z,use_quota=True,user_id='ad29047596a943f7b30e466b7d583c13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9235c89e-1bf5-45ab-8032-ee3bf0efe364),volume_type_id=9235c89e-1bf5-45ab-8032-ee3bf0efe364)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:19.334963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2343c389-dfb9-455c-8349-bb8b8e1af615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:19.340359 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2343c389-dfb9-455c-8349-bb8b8e1af615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:19.347084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2330ace-75b9-4c61-94be-82d3fcb44145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:19.353563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2330ace-75b9-4c61-94be-82d3fcb44145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d3ea70-7fc3-4c0b-8f91-c944a52e53fa', 'volume_name': 'volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:19.361373 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba5203f-c4ce-444a-adbe-9aadcddcf2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:19.366498 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba5203f-c4ce-444a-adbe-9aadcddcf2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:19.373178 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef5a105-50db-4b01-b713-2760d6d15fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:19.374556 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Volume 50d3ea70-7fc3-4c0b-8f91-c944a52e53fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa', 'volume_size': 1} Feb 12 21:24:19.375128 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] creating volume 'volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:24:19.376494 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:19.706269 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] Created reservations ['55f2e580-2298-4e25-afda-b48d2950e442', '515dd420-7937-4747-9b7f-3fc38153f83f', 'ec9dbf85-7697-48ec-8edd-0da8db3adf63', 'baf7b59c-c88d-4c21-be9a-83ce037f3db5'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:19.959862 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:20.045488 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:20.105848 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:20.111520 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] Deleted volume successfully. Feb 12 21:24:20.181441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-62071ad8-31d5-4e19-9f8a-66ac49287570 tempest-AttachVolumeTestJSON-1617998511 None] Lock "b'cinder-dbcb87d0-7039-4000-860e-900ca1b07f9d-delete_volume'" released by "delete_volume" :: held 8.540s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:20.371976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:24:20.373489 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:24:20.378490 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef5a105-50db-4b01-b713-2760d6d15fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:20.383634 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db841dd5-bdfe-4188-89d7-acf82816aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:20.517080 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Volume volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa (50d3ea70-7fc3-4c0b-8f91-c944a52e53fa): created successfully Feb 12 21:24:20.522561 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db841dd5-bdfe-4188-89d7-acf82816aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:20.530379 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Flow 'volume_create_manager' (4d0e081c-4d8f-4df9-b6d0-06cfd91740be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:20.878916 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c39e8114-1615-4c9c-9eb0-1e5c28db4a81 tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Created volume successfully. Feb 12 21:24:21.135075 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] Lock "b'cinder-5fd3ab2d-19da-4502-a2c8-54bdbfdda994-delete_volume'" acquired by "delete_volume" :: waited 0.043s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:21.290111 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:21.550149 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:24:21.552323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] Volume volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:24:21.810618 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] deleting rbd volume volume-5fd3ab2d-19da-4502-a2c8-54bdbfdda994 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:24:22.562999 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f07e357d-a6b6-41e8-970c-069f5fa3f85b tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:22.613239 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f07e357d-a6b6-41e8-970c-069f5fa3f85b tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:22.646372 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f07e357d-a6b6-41e8-970c-069f5fa3f85b tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:22.657722 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f07e357d-a6b6-41e8-970c-069f5fa3f85b tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Retype volume completed successfully. Feb 12 21:24:22.791531 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:24:22.800566 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-64600ecf-9ea6-4f76-aaba-e9dfb3859fe0 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-f155360d-3204-4c16-b0a4-b1db32a53963-delete_volume'" released by "delete_volume" :: held 8.692s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:23.726302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Lock "b'cinder-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:23.868426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:24.149909 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:24:24.152958 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Volume volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:24:24.432213 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] deleting rbd volume volume-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:24:30.233532 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] Created reservations ['df2f36ae-2522-4bbc-b03b-4a1e10520cf5', '2f1d43ca-ef52-4b22-835c-d2936cee1c34', 'f38d52bb-9e63-410d-b2f4-00ae72af31dc', '72d9423d-6379-467b-bf3c-975bfb2f6a55'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:30.513517 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:30.662904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:30.738904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:30.745602 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] Deleted volume successfully. Feb 12 21:24:30.837534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-58ab58bd-f021-4e0b-a0e3-9019f137fe22 tempest-AttachVolumeTestJSON-1617998511 None] Lock "b'cinder-5fd3ab2d-19da-4502-a2c8-54bdbfdda994-delete_volume'" released by "delete_volume" :: held 9.702s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:31.307076 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] Lock "b'cinder-e4776652-3b7a-4b3e-8749-56e170786d32-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:31.452413 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:31.671323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:24:31.671997 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] Volume volume-e4776652-3b7a-4b3e-8749-56e170786d32 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:24:31.884084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] deleting rbd volume volume-e4776652-3b7a-4b3e-8749-56e170786d32 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:24:32.071126 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:24:32.072344 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:24:32.223964 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Created reservations ['fdee651d-f798-4bd7-9722-75a2a12488b4', 'b3dee8dc-2812-4a18-aa2c-93dfcd676233', '768091a0-edde-43b2-9c35-f65a0a91615e', '9436c372-9fa8-4c94-bf4d-5d0f11f378b9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:32.535498 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:32.589821 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:32.655011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:32.659818 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Deleted volume successfully. Feb 12 21:24:32.820972 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bd81b2c7-dc02-4abb-8478-2907494f070e tempest-VolumeRetypeWithoutMigrationTest-1358775254 None] Lock "b'cinder-50d3ea70-7fc3-4c0b-8f91-c944a52e53fa-delete_volume'" released by "delete_volume" :: held 9.095s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:35.762358 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] Created reservations ['c494d321-a14a-48d2-88ff-b7b481e5ba41', '4549db07-e517-40fb-bde0-3ad46cf56267', '019731ac-f0cb-4609-98a0-3abe567c2aa8', '346c67a8-e164-4905-b974-1e22c706d88b'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:35.906699 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:35.984981 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:36.094870 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:36.105679 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] Deleted volume successfully. Feb 12 21:24:36.183955 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-cd836c1f-89e1-4239-aade-ceae5ace5ecc tempest-AttachVolumeTestJSON-1617998511 None] Lock "b'cinder-e4776652-3b7a-4b3e-8749-56e170786d32-delete_volume'" released by "delete_volume" :: held 4.877s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:41.146417 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:24:41.149950 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:24:41.150383 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:24:41.174809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Flow 'volume_create_manager' (5818da81-f88e-45aa-8b46-68a16eb0a8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:41.184062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2444779-d11e-4553-874a-10dc0fe48c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:41.194167 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:24:41.223074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2444779-d11e-4553-874a-10dc0fe48c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1290960642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1cdc4b03-3792-4dd2-832a-d1fa8368ecd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e767e342cf4ce49b2f5169b3e494bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:24:41Z,use_quota=True,user_id='049043c02c2e4aa4ab3810955fd3fe80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:41.232672 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff11e4f-cbde-4e47-812c-6fb949be0dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:41.241783 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff11e4f-cbde-4e47-812c-6fb949be0dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:41.249818 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8d3469-8b05-4972-a860-04c8f38069a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:41.255835 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8d3469-8b05-4972-a860-04c8f38069a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdc4b03-3792-4dd2-832a-d1fa8368ecd7', 'volume_name': 'volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:41.263150 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b31791d-bf2a-43e0-9c9e-b9d7aa3a5524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:41.267923 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b31791d-bf2a-43e0-9c9e-b9d7aa3a5524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:41.273883 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984f6313-bb89-4f0e-9cb5-ae8cedb74dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:41.275378 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Volume 1cdc4b03-3792-4dd2-832a-d1fa8368ecd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7', 'volume_size': 1} Feb 12 21:24:41.275924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] creating volume 'volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:24:41.277072 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:41.830442 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:24:41.831588 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:24:41.838150 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984f6313-bb89-4f0e-9cb5-ae8cedb74dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:41.847675 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810e38a5-5541-46ab-b4c8-7b9eb2224ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:41.922838 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Volume volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7 (1cdc4b03-3792-4dd2-832a-d1fa8368ecd7): created successfully Feb 12 21:24:41.932047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810e38a5-5541-46ab-b4c8-7b9eb2224ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:41.940915 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Flow 'volume_create_manager' (5818da81-f88e-45aa-8b46-68a16eb0a8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:42.008236 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9b9141fd-8818-4004-b462-5614f410d88e tempest-VolumesServicesTestJSON-1569363365 None] Created volume successfully. Feb 12 21:24:43.398412 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] Lock "b'cinder-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:43.556734 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:43.801819 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:24:43.807609 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] Volume volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:24:43.911769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] deleting rbd volume volume-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:24:47.924019 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] Created reservations ['d4e7ee37-2629-4c76-bf97-482dc1281cea', '6cbed86c-bb21-43a6-b847-b6507a5a1636', '04fc2301-bd84-4d29-ab23-673b0acc38bf', 'ab3ed7fa-188c-4f15-8221-1bcb4c6f3bb5'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:48.162694 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:48.215281 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:48.270569 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:48.280688 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] Deleted volume successfully. Feb 12 21:24:48.350148 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-22fadf23-d64d-4155-b5b6-e27abd7731da tempest-VolumesServicesTestJSON-1569363365 None] Lock "b'cinder-1cdc4b03-3792-4dd2-832a-d1fa8368ecd7-delete_volume'" released by "delete_volume" :: held 4.952s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:51.382644 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-53c7a2d1-9486-4533-8d5e-e2d6caad101f tempest-GroupsV320Test-1213244757 None] Group tempest-GroupsV320Test-Group-1464264407: creating Feb 12 21:24:51.614302 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-53c7a2d1-9486-4533-8d5e-e2d6caad101f tempest-GroupsV320Test-1213244757 None] Group tempest-GroupsV320Test-Group-1464264407: created successfully Feb 12 21:24:51.634543 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-53c7a2d1-9486-4533-8d5e-e2d6caad101f tempest-GroupsV320Test-1213244757 None] Create group completed successfully. Feb 12 21:24:53.464597 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ea10b0be-5bb7-41e0-bf55-6be7a7f76b16 tempest-GroupsV320Test-1213244757 None] Created reservations ['70a9e5c7-7fbb-45d3-be9c-0e2bb240031a'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:24:53.681508 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ea10b0be-5bb7-41e0-bf55-6be7a7f76b16 tempest-GroupsV320Test-1213244757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:53.729466 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ea10b0be-5bb7-41e0-bf55-6be7a7f76b16 tempest-GroupsV320Test-1213244757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:53.789453 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-ea10b0be-5bb7-41e0-bf55-6be7a7f76b16 tempest-GroupsV320Test-1213244757 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:24:53.803155 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ea10b0be-5bb7-41e0-bf55-6be7a7f76b16 tempest-GroupsV320Test-1213244757 None] Delete group completed successfully. Feb 12 21:24:55.485159 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:24:55.487502 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:24:55.487949 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:24:55.526279 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Flow 'volume_create_manager' (bb20afc7-2c80-4b3c-b530-9368370aa809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:55.543440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbdbdfa-81d1-4892-9b19-7943fe449c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:55.557469 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:24:55.588575 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbdbdfa-81d1-4892-9b19-7943fe449c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2094643208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f138a5f1-3115-4cbc-85a8-6ad6283b36a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f5b7f41c8664a68b9167e87c2ef4680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:24:55Z,use_quota=True,user_id='e42184a5ecb04fd285d03d6882c82759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:55.609115 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8706d0cf-fb62-4048-b770-8a9e9741d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:55.613932 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8706d0cf-fb62-4048-b770-8a9e9741d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:55.623915 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2c9a3f-6485-41a0-8bbf-98c4ed31c8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:55.629295 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2c9a3f-6485-41a0-8bbf-98c4ed31c8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f138a5f1-3115-4cbc-85a8-6ad6283b36a1', 'volume_name': 'volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:55.634581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fccca2-88ed-4e06-95cf-6531e84471fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:55.655801 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fccca2-88ed-4e06-95cf-6531e84471fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:55.657969 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51df2f9c-bc48-4fd2-b5f1-608683c3584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:55.659291 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Volume f138a5f1-3115-4cbc-85a8-6ad6283b36a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1', 'volume_size': 1} Feb 12 21:24:55.659842 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] creating volume 'volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:24:55.661074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:56.191625 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:24:56.191625 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:24:56.205271 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51df2f9c-bc48-4fd2-b5f1-608683c3584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:56.206805 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a139bffd-7051-4060-a1d8-c98f0d54d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:56.310858 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Volume volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1 (f138a5f1-3115-4cbc-85a8-6ad6283b36a1): created successfully Feb 12 21:24:56.315487 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a139bffd-7051-4060-a1d8-c98f0d54d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:56.330809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Flow 'volume_create_manager' (bb20afc7-2c80-4b3c-b530-9368370aa809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:56.420596 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2301c816-9b14-4b26-861d-0418ed485d36 tempest-VolumesTestJSON-1588431633 None] Created volume successfully. Feb 12 21:24:56.736950 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:24:56.759773 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:24:56.761238 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:24:56.810231 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (f4ce1beb-5faf-43be-b91d-71d95355b486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:56.861414 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbb51c4-c756-49dd-b9a0-220fe5a5fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:56.877858 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:24:56.899001 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbb51c4-c756-49dd-b9a0-220fe5a5fde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-52880831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aacc142f-bac9-4d58-9705-49f2b86e3a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07de9e87ea3f495f90baaf85d83b982c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:24:56Z,use_quota=True,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:56.905108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb5b04f-fde2-4690-b22f-8d9af9c787e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:56.910261 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb5b04f-fde2-4690-b22f-8d9af9c787e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:56.916099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3009163-b4ca-453c-808c-f3134044bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:57.092884 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3009163-b4ca-453c-808c-f3134044bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'volume_name': 'volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:57.100340 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa397c3e-6deb-4f47-95ce-14eef4d7f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:57.106726 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa397c3e-6deb-4f47-95ce-14eef4d7f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:57.118395 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d4994f-80b5-4deb-a711-217b43a8926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:57.121192 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Volume aacc142f-bac9-4d58-9705-49f2b86e3a0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:24:57.122217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Cloning aacc142f-bac9-4d58-9705-49f2b86e3a0a from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:24:57.148001 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:24:57.231278 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 24, 57, 157864)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:24:57.231720 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:24:57.232415 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:24:57.241630 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.093s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:24:57.242773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:24:57.251741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 24, 57, 246791)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:24:57.252444 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:24:57.252992 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:24:57.268614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:24:57.522537 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] creating snapshot='volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:24:59.674177 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a.clone_snap' to 'volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:24:59.809834 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:24:59.815436 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:24:59.815879 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:24:59.873114 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Flow 'volume_create_manager' (c7d50615-4484-4c67-81df-56504be985b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:24:59.889826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29e1fb6-783d-4d00-9f74-def3f52b0d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:59.901570 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:24:59.974878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29e1fb6-783d-4d00-9f74-def3f52b0d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-43733789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=942a8fad-6559-4371-b634-16a0127fe83c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f5b7f41c8664a68b9167e87c2ef4680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:24:58Z,use_quota=True,user_id='e42184a5ecb04fd285d03d6882c82759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:24:59.982669 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be3a7b0-da35-4292-9b99-ef0d0ef440f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:24:59.987808 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be3a7b0-da35-4292-9b99-ef0d0ef440f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.009787 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce7eac2-1afe-4e66-a311-4ee19e22231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.019914 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce7eac2-1afe-4e66-a311-4ee19e22231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942a8fad-6559-4371-b634-16a0127fe83c', 'volume_name': 'volume-942a8fad-6559-4371-b634-16a0127fe83c', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.025825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba56352-0eb1-48d4-900d-c2914280036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.030185 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba56352-0eb1-48d4-900d-c2914280036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.036031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146fdbf8-9661-44ee-a07b-8612b5dfa096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.037375 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Volume 942a8fad-6559-4371-b634-16a0127fe83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942a8fad-6559-4371-b634-16a0127fe83c', 'volume_size': 1} Feb 12 21:25:00.037974 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] creating volume 'volume-942a8fad-6559-4371-b634-16a0127fe83c' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:25:00.039759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:00.757988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:25:00.761251 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:25:00.769163 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:25:00.820098 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Flow 'volume_create_manager' (76e9eb12-3791-4836-ad7a-cb8403f52243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:00.829321 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eab9e7-114a-4f74-875a-a83da7b7d16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.837046 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:25:00.896920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eab9e7-114a-4f74-875a-a83da7b7d16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1588628703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3d30370-4c4e-47a5-8d5c-5895ff38a489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26401294be3c49e69ea7c2ea190bbce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:25:01Z,use_quota=True,user_id='08559772b24e498893b15c72d9f691d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.910435 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde96673-3d9a-4174-a72d-926a36e5453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.924458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde96673-3d9a-4174-a72d-926a36e5453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.936427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac22bf72-1ba3-43d1-bcaa-30ab97db4779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.948286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac22bf72-1ba3-43d1-bcaa-30ab97db4779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d30370-4c4e-47a5-8d5c-5895ff38a489', 'volume_name': 'volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.966217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80afc9c3-fd43-4bd6-a3a4-e115f783084a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.982156 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80afc9c3-fd43-4bd6-a3a4-e115f783084a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:00.988365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed3aa60-f5c6-4a76-a1cb-dfb04b303ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:00.992537 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Volume f3d30370-4c4e-47a5-8d5c-5895ff38a489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489', 'volume_size': 1} Feb 12 21:25:00.992920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] creating volume 'volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:25:00.995090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:01.126396 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:25:01.126887 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:25:01.137286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146fdbf8-9661-44ee-a07b-8612b5dfa096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942a8fad-6559-4371-b634-16a0127fe83c', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:01.150665 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662f0c8c-7976-49af-b64d-d3de0185d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:01.288603 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Volume volume-942a8fad-6559-4371-b634-16a0127fe83c (942a8fad-6559-4371-b634-16a0127fe83c): created successfully Feb 12 21:25:01.292599 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662f0c8c-7976-49af-b64d-d3de0185d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:01.309246 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Flow 'volume_create_manager' (c7d50615-4484-4c67-81df-56504be985b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:01.412694 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bb6a7b52-e258-41da-857c-c18fa988ec2c tempest-VolumesTestJSON-1588431633 None] Created volume successfully. Feb 12 21:25:01.595302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:01.598418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:25:01.598800 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:25:02.212903 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:25:02.219911 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Marking volume aacc142f-bac9-4d58-9705-49f2b86e3a0a as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:25:02.243350 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:25:02.247052 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:25:02.253082 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed3aa60-f5c6-4a76-a1cb-dfb04b303ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:02.260426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f50ddff-dd24-4e8c-b15c-fbeac4b6e667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:02.328954 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to aacc142f-bac9-4d58-9705-49f2b86e3a0a. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:25:02.331437 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Creating volume glance metadata for volume aacc142f-bac9-4d58-9705-49f2b86e3a0a backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:25:02.496829 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Volume volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489 (f3d30370-4c4e-47a5-8d5c-5895ff38a489): created successfully Feb 12 21:25:02.510835 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f50ddff-dd24-4e8c-b15c-fbeac4b6e667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:02.544089 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Flow 'volume_create_manager' (76e9eb12-3791-4836-ad7a-cb8403f52243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:02.622641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d4994f-80b5-4deb-a711-217b43a8926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:02.628437 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099ab0a2-7b6f-4d4c-8f1c-2280eb8ff0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:02.658954 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a6b9df05-6098-41be-8eef-b755654ddfe8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Created volume successfully. Feb 12 21:25:02.706807 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a (aacc142f-bac9-4d58-9705-49f2b86e3a0a): created successfully Feb 12 21:25:02.713403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099ab0a2-7b6f-4d4c-8f1c-2280eb8ff0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:02.729473 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (f4ce1beb-5faf-43be-b91d-71d95355b486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:02.774820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:25:02.782346 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:25:02.782799 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:25:02.838332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Flow 'volume_create_manager' (ea6cf5b0-9241-4825-90e7-04c9ca9f9d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:02.861266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd17708-c6ee-4c9a-91ca-64ac861dc8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:02.885817 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] Created volume successfully. Feb 12 21:25:02.899562 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b63b9b-654d-479c-bbaf-61b0235dd5ed tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:25:02.935262 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd17708-c6ee-4c9a-91ca-64ac861dc8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-843503281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3586ccc6-e4ab-4aeb-a1af-73efbf85555a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f5b7f41c8664a68b9167e87c2ef4680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:25:03Z,use_quota=True,user_id='e42184a5ecb04fd285d03d6882c82759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:02.952563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe8931-4aa1-46e2-807d-a59c4dc6de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:02.961762 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe8931-4aa1-46e2-807d-a59c4dc6de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:02.996167 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd845fe3-1586-4eb3-8e1a-9c91b247fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:03.023661 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd845fe3-1586-4eb3-8e1a-9c91b247fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3586ccc6-e4ab-4aeb-a1af-73efbf85555a', 'volume_name': 'volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:03.038850 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34d9122-2370-42c0-95b1-ab352fff5945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:03.107879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34d9122-2370-42c0-95b1-ab352fff5945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:03.107879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0f6363-9826-4396-9d9d-3288d7605a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:03.107879 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Volume 3586ccc6-e4ab-4aeb-a1af-73efbf85555a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a', 'volume_size': 1} Feb 12 21:25:03.107879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] creating volume 'volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:25:03.107879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:03.494649 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-34aa1f1e-e46f-4b74-8955-d320a46354cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:03.912085 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:25:03.912935 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:25:03.917212 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0f6363-9826-4396-9d9d-3288d7605a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:03.927652 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bad2c55-455e-416e-9f5b-835132404f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:04.041836 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Volume volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a (3586ccc6-e4ab-4aeb-a1af-73efbf85555a): created successfully Feb 12 21:25:04.064457 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bad2c55-455e-416e-9f5b-835132404f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:04.090375 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Flow 'volume_create_manager' (ea6cf5b0-9241-4825-90e7-04c9ca9f9d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:04.207482 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-11a8fabc-2c4e-4e85-863b-913e83fcbec1 tempest-VolumesTestJSON-1588431633 None] Created volume successfully. Feb 12 21:25:04.493938 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-34bab073-440d-4c7f-906d-e7530e98c410 req-c2a094b3-ec4b-470e-96f2-0d87c7d5ec24 tempest-VolumesSnapshotTestJSON-1959179807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:25:06.207772 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-34bab073-440d-4c7f-906d-e7530e98c410 req-c2a094b3-ec4b-470e-96f2-0d87c7d5ec24 tempest-VolumesSnapshotTestJSON-1959179807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.713s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:25:06.208557 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-34bab073-440d-4c7f-906d-e7530e98c410 req-c2a094b3-ec4b-470e-96f2-0d87c7d5ec24 tempest-VolumesSnapshotTestJSON-1959179807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:25:06.333473 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-34bab073-440d-4c7f-906d-e7530e98c410 req-c2a094b3-ec4b-470e-96f2-0d87c7d5ec24 tempest-VolumesSnapshotTestJSON-1959179807 None] Connection info returned from driver {'name': 'volumes/volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aacc142f-bac9-4d58-9705-49f2b86e3a0a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c5178d8b-0ca4-47f4-9e8e-ba8b5da50dca'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:25:06.529926 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-34bab073-440d-4c7f-906d-e7530e98c410 req-c2a094b3-ec4b-470e-96f2-0d87c7d5ec24 tempest-VolumesSnapshotTestJSON-1959179807 None] attachment_update completed successfully. Feb 12 21:25:06.803313 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-34aa1f1e-e46f-4b74-8955-d320a46354cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Create snapshot completed successfully Feb 12 21:25:07.710440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] Lock "b'cinder-3586ccc6-e4ab-4aeb-a1af-73efbf85555a-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:07.887790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:08.173483 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:25:08.173978 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] Volume volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:08.380455 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] deleting rbd volume volume-3586ccc6-e4ab-4aeb-a1af-73efbf85555a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:25:08.417812 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c23b8c72-ca9f-43c7-ad48-8464ec8917f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Lock "b'cinder-237b077e-10ab-45a1-8e7a-a755e4511062-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:08.419335 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c23b8c72-ca9f-43c7-ad48-8464ec8917f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:09.209074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:25:09.214376 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:25:09.214857 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:25:09.235687 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Flow 'volume_create_manager' (557e785c-36d9-48e9-aa81-8aa686dcc395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:09.242877 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e71ec9-e004-46f6-a3f5-23db0a86a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:09.249649 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:25:09.270426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e71ec9-e004-46f6-a3f5-23db0a86a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1777617702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2d10836f-c81c-43c2-a4e6-88b029960700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d77964723849248be9f2cf3eb83326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:25:09Z,use_quota=True,user_id='86e55924de4243a0addb22761c5fe91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:09.277855 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2196c3b-88cd-42b2-9081-b03493578631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:09.283658 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2196c3b-88cd-42b2-9081-b03493578631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:09.289618 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acc070c-0cd4-4f08-8d4d-6c6c35c871e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:09.294294 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acc070c-0cd4-4f08-8d4d-6c6c35c871e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d10836f-c81c-43c2-a4e6-88b029960700', 'volume_name': 'volume-2d10836f-c81c-43c2-a4e6-88b029960700', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:09.300360 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003f1f8f-b8a4-4089-9607-e03b3ef4c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:09.305329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003f1f8f-b8a4-4089-9607-e03b3ef4c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:09.311725 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcbcb95-a2e9-4212-aed2-1718aeea6e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:09.313330 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume 2d10836f-c81c-43c2-a4e6-88b029960700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d10836f-c81c-43c2-a4e6-88b029960700', 'volume_size': 1} Feb 12 21:25:09.313945 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] creating volume 'volume-2d10836f-c81c-43c2-a4e6-88b029960700' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:25:09.315436 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:09.698723 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6991c3ed-9f55-489b-bf70-5cddb6952769 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:10.222782 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:25:10.223872 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:25:10.232755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcbcb95-a2e9-4212-aed2-1718aeea6e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d10836f-c81c-43c2-a4e6-88b029960700', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:10.251157 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd137005-7556-47cf-b477-dee862a07b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:10.316226 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume volume-2d10836f-c81c-43c2-a4e6-88b029960700 (2d10836f-c81c-43c2-a4e6-88b029960700): created successfully Feb 12 21:25:10.322621 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd137005-7556-47cf-b477-dee862a07b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:10.334791 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Flow 'volume_create_manager' (557e785c-36d9-48e9-aa81-8aa686dcc395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:10.418898 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9af9fc2a-c781-4e36-88ff-fe6a22547b60 tempest-VolumeQuotasAdminTestJSON-213658924 None] Created volume successfully. Feb 12 21:25:10.648540 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:25:10.649588 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:10.723502 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:10.769120 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:11.329099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-c23b8c72-ca9f-43c7-ad48-8464ec8917f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Created reservations ['2b8d1b49-0f99-4272-a9ac-7b1c0240566c', '7b6a3b30-26de-4cfb-8039-a6cb0d761365', 'a9f1550f-699c-42f8-a290-c46977d1fc58', '6fb035a2-4e1a-450f-9606-48ff1052b336'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:11.535660 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] Lock "b'cinder-2d10836f-c81c-43c2-a4e6-88b029960700-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:11.653382 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c23b8c72-ca9f-43c7-ad48-8464ec8917f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Delete snapshot completed successfully. Feb 12 21:25:11.659103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c23b8c72-ca9f-43c7-ad48-8464ec8917f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Lock "b'cinder-237b077e-10ab-45a1-8e7a-a755e4511062-delete_snapshot'" released by "delete_snapshot" :: held 3.245s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:11.733585 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:11.939498 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:25:11.940554 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume volume-2d10836f-c81c-43c2-a4e6-88b029960700 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:12.179352 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] deleting rbd volume volume-2d10836f-c81c-43c2-a4e6-88b029960700 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:25:12.785768 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Lock "b'cinder-f3d30370-4c4e-47a5-8d5c-5895ff38a489-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:13.014175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:13.322300 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:25:13.322713 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Volume volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:13.628607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] deleting rbd volume volume-f3d30370-4c4e-47a5-8d5c-5895ff38a489 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:25:13.631652 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6991c3ed-9f55-489b-bf70-5cddb6952769 tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:25:14.419196 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] Created reservations ['6d20d5a2-7c3b-4b85-9e5f-060db97b8184', '023061a9-91ee-4690-b3b0-b38d8c6e3267', '6fbf6d30-9dbf-4130-be5b-dfca42aa76bc', '4812659e-4b00-4d74-bd94-2db4f295d170'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:14.623574 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c71d5e75-91ec-4533-878a-3f40d9c2de36 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:14.898406 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:14.956611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:15.001029 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:15.006076 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] Deleted volume successfully. Feb 12 21:25:15.101194 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d0f4ddb6-de47-4edd-ad5b-552e2c423de2 tempest-VolumesTestJSON-1588431633 None] Lock "b'cinder-3586ccc6-e4ab-4aeb-a1af-73efbf85555a-delete_volume'" released by "delete_volume" :: held 7.391s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:15.737734 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] Lock "b'cinder-942a8fad-6559-4371-b634-16a0127fe83c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:15.876760 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:16.453045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:25:16.453710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] Volume volume-942a8fad-6559-4371-b634-16a0127fe83c is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:16.636240 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] deleting rbd volume volume-942a8fad-6559-4371-b634-16a0127fe83c {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:25:17.464039 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c71d5e75-91ec-4533-878a-3f40d9c2de36 tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:25:19.127418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a20c963b-d2de-4f91-8cb7-6143c14a119b tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:19.628849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] Created reservations ['1e65215f-d520-4449-98a1-ef5daf3e726a', '1f969f4b-9fc6-40f9-8770-c3cc9b8e26ad', '48bc0c30-18f0-4cf5-b5c1-2684b7076198', 'eaf0f7cc-ecc9-4223-8e43-cdcc004b7dbc'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:19.814367 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:19.865192 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:19.909961 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:19.915521 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] Deleted volume successfully. Feb 12 21:25:19.978176 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8fc347bf-6ce7-459a-9b6c-67c3aa15de16 tempest-VolumeQuotasAdminTestJSON-213658924 None] Lock "b'cinder-2d10836f-c81c-43c2-a4e6-88b029960700-delete_volume'" released by "delete_volume" :: held 8.445s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:20.584898 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Created reservations ['c7310d71-c0f7-478e-a1a1-8c95ea0f74b2', '0517816d-0694-4d26-a609-c5cc11adb042', '9fb1241f-76a9-4dc4-aa47-df0775083aaf', 'de687fee-69d0-447e-be64-a15d5da03d29'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:20.881917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:20.954347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:21.019666 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:21.035394 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Deleted volume successfully. Feb 12 21:25:21.188810 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bf974517-1924-4028-9565-d18eaaf6b106 tempest-VolumeSnapshotQuotasNegativeTestJSON-1435170131 None] Lock "b'cinder-f3d30370-4c4e-47a5-8d5c-5895ff38a489-delete_volume'" released by "delete_volume" :: held 8.405s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:21.459417 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:25:21.462078 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:25:21.462907 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:25:21.498740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Flow 'volume_create_manager' (6a80a15a-f443-4346-a2af-63244d8ce63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:21.517712 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1218ae8e-fa68-43fa-82d8-bf6940f276c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:21.536681 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:25:21.567180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1218ae8e-fa68-43fa-82d8-bf6940f276c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-933523770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=56397025-5f4d-486b-b9ee-dba07811ba2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d77964723849248be9f2cf3eb83326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:25:21Z,use_quota=True,user_id='86e55924de4243a0addb22761c5fe91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:21.574201 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dc0d3d-f038-4807-a215-7a09dff091e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:21.580361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dc0d3d-f038-4807-a215-7a09dff091e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:21.586988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af60aa2-3f96-487f-ac4e-8f71c3be0c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:21.592332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af60aa2-3f96-487f-ac4e-8f71c3be0c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56397025-5f4d-486b-b9ee-dba07811ba2f', 'volume_name': 'volume-56397025-5f4d-486b-b9ee-dba07811ba2f', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:21.604078 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d72f4-5245-44a8-836d-1c7066e520cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:21.608676 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d72f4-5245-44a8-836d-1c7066e520cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:21.614821 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df0c9e2-84b0-43df-b368-b1ec42e343c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:21.615957 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume 56397025-5f4d-486b-b9ee-dba07811ba2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56397025-5f4d-486b-b9ee-dba07811ba2f', 'volume_size': 1} Feb 12 21:25:21.616356 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] creating volume 'volume-56397025-5f4d-486b-b9ee-dba07811ba2f' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:25:21.618387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:22.630026 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a20c963b-d2de-4f91-8cb7-6143c14a119b tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:25:22.664355 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:25:22.664511 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:25:22.672620 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df0c9e2-84b0-43df-b368-b1ec42e343c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56397025-5f4d-486b-b9ee-dba07811ba2f', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:22.680982 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946607a9-fe52-4915-beb8-461449100bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:25:22.730066 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Volume volume-56397025-5f4d-486b-b9ee-dba07811ba2f (56397025-5f4d-486b-b9ee-dba07811ba2f): created successfully Feb 12 21:25:22.736273 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946607a9-fe52-4915-beb8-461449100bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:25:22.749450 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Flow 'volume_create_manager' (6a80a15a-f443-4346-a2af-63244d8ce63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:25:22.825300 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-952cdf5c-417b-45c5-bd86-f2cf1ebc5b38 tempest-VolumeQuotasAdminTestJSON-213658924 None] Created volume successfully. Feb 12 21:25:23.313466 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-17bf0aac-82d0-43a8-bd01-a4b5c384d5ba tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-147025b6-b0d9-4380-9727-8fb074cae5fc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.034s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:23.316569 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-17bf0aac-82d0-43a8-bd01-a4b5c384d5ba tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:23.647517 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] Created reservations ['5fbccd1b-0eff-4f58-aea0-2ffad2cc4635', '19eb92ce-76fc-4e58-b360-91da1bb76438', '6f4f18ed-8b97-4e3b-ad8f-6627e2f61baa', '06e22084-1433-4f9b-b2a4-d779898de6d7'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:23.852571 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:23.926007 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:24.008926 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:24.013562 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] Deleted volume successfully. Feb 12 21:25:24.103668 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-711aea75-2597-48a6-9af7-8c64b76d13fe tempest-VolumesTestJSON-1588431633 None] Lock "b'cinder-942a8fad-6559-4371-b634-16a0127fe83c-delete_volume'" released by "delete_volume" :: held 8.366s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:24.629679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] Lock "b'cinder-f138a5f1-3115-4cbc-85a8-6ad6283b36a1-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:24.797006 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:25.001000 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:25:25.001441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] Volume volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:25.127778 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] deleting rbd volume volume-f138a5f1-3115-4cbc-85a8-6ad6283b36a1 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:25:25.163051 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-01c3c560-ed21-4b4d-8c8d-47f6d65d291b tempest-VolumeQuotasAdminTestJSON-722905123 None] Transfer volume completed successfully. Feb 12 21:25:26.368698 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] Lock "b'cinder-56397025-5f4d-486b-b9ee-dba07811ba2f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:26.502924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:26.755399 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:25:26.759534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] Volume volume-56397025-5f4d-486b-b9ee-dba07811ba2f is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:25:26.968823 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] deleting rbd volume volume-56397025-5f4d-486b-b9ee-dba07811ba2f {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:25:31.121673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] Created reservations ['8b6b9b54-34f3-45c2-b483-17eade333fd5', '853309f6-94c1-45bc-8bbc-badf74bfb501', '2be4dd97-6950-41f3-96a2-c1b9322defa6', 'acb99830-bd68-48d2-9162-2314bbeb2395'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:31.392187 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:31.493917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:31.555320 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:31.559599 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] Deleted volume successfully. Feb 12 21:25:31.630039 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0e7e2c90-481b-4c02-88d3-eab961ce0305 tempest-VolumesTestJSON-1588431633 None] Lock "b'cinder-f138a5f1-3115-4cbc-85a8-6ad6283b36a1-delete_volume'" released by "delete_volume" :: held 7.001s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:32.522441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] Created reservations ['a199500c-3761-423b-9470-d512e24391b7', '93f618c4-ff21-497f-8496-635d3cf31bd8', '89b875a0-4730-4a4a-b6fd-fb4102892ebe', '5c98c3d6-313b-481d-90f6-9d60c4acb339'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:32.818869 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:33.019242 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:25:33.083806 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:25:33.089034 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] Deleted volume successfully. Feb 12 21:25:33.177534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-dd66c289-8a7f-4977-b88d-6e976a79efa6 tempest-VolumeQuotasAdminTestJSON-377023592 None] Lock "b'cinder-56397025-5f4d-486b-b9ee-dba07811ba2f-delete_volume'" released by "delete_volume" :: held 6.809s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:54.332504 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-17bf0aac-82d0-43a8-bd01-a4b5c384d5ba tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['f4157a3b-0761-4e09-9161-77c46364f072', '1042b3cc-8d16-4aa4-827a-a010967f50ef', '03284e5f-9127-45f9-9aff-e38d406bad29', '31e24e82-ffb1-40fa-9bc5-8c4f97f45f51'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:25:54.796880 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-17bf0aac-82d0-43a8-bd01-a4b5c384d5ba tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:25:54.803164 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-17bf0aac-82d0-43a8-bd01-a4b5c384d5ba tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-147025b6-b0d9-4380-9727-8fb074cae5fc-delete_snapshot'" released by "delete_snapshot" :: held 31.490s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:25:54.939195 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1dfac8e6-7d28-47fd-82bd-d54d8cc62e4d tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-5aa5fd06-dffe-4bb8-b848-3b38178d6a50-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:25:54.941103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1dfac8e6-7d28-47fd-82bd-d54d8cc62e4d tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:01.533849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:26:01.540594 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:26:01.541335 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:26:01.569874 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Flow 'volume_create_manager' (e575251d-ba3b-4ee6-9f97-31e4dd1a22ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:01.587393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33c7f5f-8dbc-4ec7-adab-c52caf9dca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:01.600489 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:26:01.620375 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33c7f5f-8dbc-4ec7-adab-c52caf9dca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-659051227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab3eb815-4b1b-4dd5-85ce-48c436954406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a46036bc674450f898e2036694a8495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:26:01Z,use_quota=True,user_id='124a844d508a4381bd0637ef083dc6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9510ee6-d8bf-452f-9c52-537f1ca55f27),volume_type_id=f9510ee6-d8bf-452f-9c52-537f1ca55f27)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:01.631327 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce79a26-5a80-43ae-bb57-c4a4b99793d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:01.639704 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce79a26-5a80-43ae-bb57-c4a4b99793d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:01.649966 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ab2fca-f636-46ac-9176-27c3c0449854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:01.656734 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ab2fca-f636-46ac-9176-27c3c0449854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3eb815-4b1b-4dd5-85ce-48c436954406', 'volume_name': 'volume-ab3eb815-4b1b-4dd5-85ce-48c436954406', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:01.664444 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6835208c-4d6e-470e-9d3d-9b90aef7a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:01.668888 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6835208c-4d6e-470e-9d3d-9b90aef7a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:01.676768 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081ae076-248d-4337-b1d6-187702d0bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:01.678094 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Volume ab3eb815-4b1b-4dd5-85ce-48c436954406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3eb815-4b1b-4dd5-85ce-48c436954406', 'volume_size': 1} Feb 12 21:26:01.678806 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] creating volume 'volume-ab3eb815-4b1b-4dd5-85ce-48c436954406' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:26:01.680231 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:02.350286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:26:02.351091 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:26:02.356640 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081ae076-248d-4337-b1d6-187702d0bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3eb815-4b1b-4dd5-85ce-48c436954406', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:02.363045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8d8674-6bb2-48a9-b8b7-3a3d8816fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:02.453051 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Volume volume-ab3eb815-4b1b-4dd5-85ce-48c436954406 (ab3eb815-4b1b-4dd5-85ce-48c436954406): created successfully Feb 12 21:26:02.476574 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8d8674-6bb2-48a9-b8b7-3a3d8816fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:02.496867 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Flow 'volume_create_manager' (e575251d-ba3b-4ee6-9f97-31e4dd1a22ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:02.589673 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cd844907-8a04-42a2-84dd-8cc0331d7455 tempest-VolumeTypesTest-1606991496 None] Created volume successfully. Feb 12 21:26:04.424487 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3199ef7d-3135-42d6-8bd3-67aaff9af9b8 tempest-VolumeTypesTest-1606991496 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:04.468070 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3199ef7d-3135-42d6-8bd3-67aaff9af9b8 tempest-VolumeTypesTest-1606991496 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:04.605633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-3199ef7d-3135-42d6-8bd3-67aaff9af9b8 tempest-VolumeTypesTest-1606991496 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:26:04.611911 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3199ef7d-3135-42d6-8bd3-67aaff9af9b8 tempest-VolumeTypesTest-1606991496 None] Retype volume completed successfully. Feb 12 21:26:06.619629 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:26:06.623856 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:26:06.624754 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:26:06.697121 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (277cd0d0-aa75-4b42-af1b-c06954faeb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:06.710028 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0007536a-50eb-4da7-ab98-7ac8e3fd0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:06.730666 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:26:06.752636 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0007536a-50eb-4da7-ab98-7ac8e3fd0d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1013789975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=868e717f-5935-4484-a35f-45e4f9eaac9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11b938ee814f3180aa6e0f37c4e1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:26:06Z,use_quota=True,user_id='cc56a9a0488e44d7935295ed39bfbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:06.758909 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89764c58-ab3c-4c1f-9fe4-80520fd04e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:06.763446 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89764c58-ab3c-4c1f-9fe4-80520fd04e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:06.770284 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683b5048-04ff-4546-a241-d1bb997efea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:06.935448 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683b5048-04ff-4546-a241-d1bb997efea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '868e717f-5935-4484-a35f-45e4f9eaac9f', 'volume_name': 'volume-868e717f-5935-4484-a35f-45e4f9eaac9f', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:06.958234 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f879e5d-5c2b-4142-b4e3-04e3f0669d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:06.976297 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f879e5d-5c2b-4142-b4e3-04e3f0669d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:06.991902 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ecf82-368b-4f42-bede-4e0677f7e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:07.005269 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Volume 868e717f-5935-4484-a35f-45e4f9eaac9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-868e717f-5935-4484-a35f-45e4f9eaac9f', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:26:07.007416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Cloning 868e717f-5935-4484-a35f-45e4f9eaac9f from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:26:07.035905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.028s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:26:07.126918 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 26, 7, 50518)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:26:07.127688 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:26:07.128274 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:26:07.136721 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.098s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:26:07.136721 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:26:07.151741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 26, 7, 141277)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:26:07.152472 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:26:07.154783 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:26:07.223293 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:07.457870 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] creating snapshot='volume-868e717f-5935-4484-a35f-45e4f9eaac9f.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:26:09.001184 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-868e717f-5935-4484-a35f-45e4f9eaac9f.clone_snap' to 'volume-868e717f-5935-4484-a35f-45e4f9eaac9f' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:26:09.043843 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Lock "b'cinder-ab3eb815-4b1b-4dd5-85ce-48c436954406-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:26:09.210748 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:09.624982 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:26:09.625526 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Volume volume-ab3eb815-4b1b-4dd5-85ce-48c436954406 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:26:09.818630 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] deleting rbd volume volume-ab3eb815-4b1b-4dd5-85ce-48c436954406 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:26:10.428399 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:26:10.430313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:26:10.430836 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:26:11.126347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:26:11.127305 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Marking volume 868e717f-5935-4484-a35f-45e4f9eaac9f as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:26:11.138200 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:26:11.138200 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:11.267727 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:11.367371 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:26:11.488861 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 868e717f-5935-4484-a35f-45e4f9eaac9f. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:26:11.495373 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Creating volume glance metadata for volume 868e717f-5935-4484-a35f-45e4f9eaac9f backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:26:11.708258 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ecf82-368b-4f42-bede-4e0677f7e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868e717f-5935-4484-a35f-45e4f9eaac9f', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:11.716441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e589b2-8619-4e26-8b4e-356a00555d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:11.846976 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Volume volume-868e717f-5935-4484-a35f-45e4f9eaac9f (868e717f-5935-4484-a35f-45e4f9eaac9f): created successfully Feb 12 21:26:11.852131 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e589b2-8619-4e26-8b4e-356a00555d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:11.861525 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (277cd0d0-aa75-4b42-af1b-c06954faeb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:11.965811 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b7db256b-1e04-43a2-961c-1f0b92ade25e tempest-TestVolumeBootPattern-1530501963 None] Created volume successfully. Feb 12 21:26:13.996040 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b2cb3c5-3e66-4d99-9748-a523f82b200d tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:14.270478 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1412617632 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1412617632, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:26:14.272454 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1412617632 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1412617632, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:26:14.346023 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Created reservations ['00a8a1de-8de2-4239-bc50-3551325d1384', 'cb16b5b6-5ba8-4244-a00e-6405dc3105c9', '092bceeb-8d5c-4609-8b97-3d2e0435ff48', 'b7c709f1-9be8-4074-9ff9-8dca20c4c6d7'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:26:14.597673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:14.669028 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:14.743612 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:26:14.758515 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Deleted volume successfully. Feb 12 21:26:14.859485 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b3fb4bfc-ff3f-4f3d-a844-c66d2b4daaf6 tempest-VolumeTypesTest-1606991496 None] Lock "b'cinder-ab3eb815-4b1b-4dd5-85ce-48c436954406-delete_volume'" released by "delete_volume" :: held 5.810s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:26:16.743912 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9b2cb3c5-3e66-4d99-9748-a523f82b200d tempest-TestVolumeBootPattern-1530501963 None] Create snapshot completed successfully Feb 12 21:26:24.751108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:26:24.757172 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:26:24.757717 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:26:24.844763 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (5ac68afa-e0d2-4de1-9245-a9b552db38b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:24.874024 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c678fb-f92a-4ed8-821f-b3ab362760c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:24.894576 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:26:24.930969 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c678fb-f92a-4ed8-821f-b3ab362760c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:26:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9c0738d-260b-411e-aba8-920ee28f2c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11b938ee814f3180aa6e0f37c4e1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fef39ac-97f4-4395-ab0f-a44a2e3c59e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:26:24Z,use_quota=True,user_id='cc56a9a0488e44d7935295ed39bfbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:24.947329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f019385-2b4a-46dd-a9ee-17e9a5de39e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:24.964498 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f019385-2b4a-46dd-a9ee-17e9a5de39e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:24.981593 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5928e8a0-8c37-48f5-9208-d0415caec914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:25.001259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5928e8a0-8c37-48f5-9208-d0415caec914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9c0738d-260b-411e-aba8-920ee28f2c81', 'volume_name': 'volume-a9c0738d-260b-411e-aba8-920ee28f2c81', 'volume_size': 1, 'snapshot_id': '5fef39ac-97f4-4395-ab0f-a44a2e3c59e5'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:25.007295 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3b777b-d6bc-4d7b-82c9-45e8abbb1ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:25.016933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3b777b-d6bc-4d7b-82c9-45e8abbb1ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:25.039136 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd282d25-693c-459b-89a6-ae1b987e9835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:25.040347 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Volume a9c0738d-260b-411e-aba8-920ee28f2c81: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9c0738d-260b-411e-aba8-920ee28f2c81', 'volume_size': 1, 'snapshot_id': '5fef39ac-97f4-4395-ab0f-a44a2e3c59e5'} Feb 12 21:26:25.142144 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] cloning volumes/volume-868e717f-5935-4484-a35f-45e4f9eaac9f@snapshot-5fef39ac-97f4-4395-ab0f-a44a2e3c59e5 to volume-a9c0738d-260b-411e-aba8-920ee28f2c81 {{(pid=134690) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 12 21:26:25.157414 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:25.310988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:26.321262 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-1dfac8e6-7d28-47fd-82bd-d54d8cc62e4d tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['e686e61c-338d-4d0c-916b-cf08a0e59589', '4245f4a3-7b65-4369-aa46-72f90a443afe', '76107735-64dd-4b40-be80-3c5905bc7749', 'e9e0362c-beb8-4b42-a6a7-235237f1148c'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:26:26.680372 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1dfac8e6-7d28-47fd-82bd-d54d8cc62e4d tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:26:26.687008 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1dfac8e6-7d28-47fd-82bd-d54d8cc62e4d tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-5aa5fd06-dffe-4bb8-b848-3b38178d6a50-delete_snapshot'" released by "delete_snapshot" :: held 31.747s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:26:27.120633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:26:27.121209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:26:27.142542 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Marking volume a9c0738d-260b-411e-aba8-920ee28f2c81 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:26:27.246660 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Copying metadata from snapshot 5fef39ac-97f4-4395-ab0f-a44a2e3c59e5 to a9c0738d-260b-411e-aba8-920ee28f2c81. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 12 21:26:27.409343 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd282d25-693c-459b-89a6-ae1b987e9835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c0738d-260b-411e-aba8-920ee28f2c81', 'volume_size': 1, 'snapshot_id': '5fef39ac-97f4-4395-ab0f-a44a2e3c59e5'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:27.415697 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6b20b7-ac51-40e8-92e1-bc96f8e03093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:27.550640 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Volume volume-a9c0738d-260b-411e-aba8-920ee28f2c81 (a9c0738d-260b-411e-aba8-920ee28f2c81): created successfully Feb 12 21:26:27.560588 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6b20b7-ac51-40e8-92e1-bc96f8e03093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:27.576038 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (5ac68afa-e0d2-4de1-9245-a9b552db38b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:27.687343 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-57fa0031-337e-4193-a3f1-606ad5024190 tempest-TestVolumeBootPattern-1530501963 None] Created volume successfully. Feb 12 21:26:27.783449 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a346c920-a573-4110-a343-de248e3c26e2 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-7f6ee831-ccad-4acf-9806-42cc856ddd40-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:26:27.787716 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a346c920-a573-4110-a343-de248e3c26e2 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:28.270837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:26:28.285232 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:26:28.285952 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:26:28.323836 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Flow 'volume_create_manager' (3e986b1a-ac38-46e8-b257-f539c321673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:28.333310 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd033e5-c3d6-4e76-b719-2c6f0d3e623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:28.342422 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:26:28.398364 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd033e5-c3d6-4e76-b719-2c6f0d3e623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-508856808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ceb3038-56ae-4849-ae5c-519aa20fe8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d681130566a4186bb8290bdfe443875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:26:28Z,use_quota=True,user_id='4ad057a7286a4ab3a992b9fdb925b4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:28.418053 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dcabd1-b161-474c-abc6-5a027e9eebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:28.448617 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dcabd1-b161-474c-abc6-5a027e9eebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:28.458976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e3d63-48df-4bd8-ab80-e3e4b725a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:28.473629 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e3d63-48df-4bd8-ab80-e3e4b725a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ceb3038-56ae-4849-ae5c-519aa20fe8fd', 'volume_name': 'volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:28.489875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ab49b8-7424-4c08-a1bd-93a14d5b39bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:28.502593 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ab49b8-7424-4c08-a1bd-93a14d5b39bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:28.514315 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3a6bcd-4114-4976-9d1d-7d24e368118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:28.521042 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Volume 9ceb3038-56ae-4849-ae5c-519aa20fe8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd', 'volume_size': 1} Feb 12 21:26:28.521465 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] creating volume 'volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:26:28.523162 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:29.247282 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:26:29.247993 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:26:29.252614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3a6bcd-4114-4976-9d1d-7d24e368118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:29.263645 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b26f01-1006-4415-8363-95e77721a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:29.360161 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Volume volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd (9ceb3038-56ae-4849-ae5c-519aa20fe8fd): created successfully Feb 12 21:26:29.364233 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b26f01-1006-4415-8363-95e77721a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:29.370042 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Flow 'volume_create_manager' (3e986b1a-ac38-46e8-b257-f539c321673f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:29.486467 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-43ee4bd0-efdc-4906-8da5-a18a5d4a1319 tempest-AbsoluteLimitsTests-451389352 None] Created volume successfully. Feb 12 21:26:30.464663 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] Lock "b'cinder-9ceb3038-56ae-4849-ae5c-519aa20fe8fd-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:26:30.637879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:30.830544 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:26:30.831575 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] Volume volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:26:30.903447 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] deleting rbd volume volume-9ceb3038-56ae-4849-ae5c-519aa20fe8fd {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:26:31.165607 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-7efd1c6a-d3d3-455a-ba62-bb681fffd377 tempest-TestVolumeBootPattern-1530501963 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:26:32.395701 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-7efd1c6a-d3d3-455a-ba62-bb681fffd377 tempest-TestVolumeBootPattern-1530501963 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.230s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:26:32.397224 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-7efd1c6a-d3d3-455a-ba62-bb681fffd377 tempest-TestVolumeBootPattern-1530501963 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a9c0738d-260b-411e-aba8-920ee28f2c81', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'a9c0738d-260b-411e-aba8-920ee28f2c81', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:26:32.549379 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-7efd1c6a-d3d3-455a-ba62-bb681fffd377 tempest-TestVolumeBootPattern-1530501963 None] Connection info returned from driver {'name': 'volumes/volume-a9c0738d-260b-411e-aba8-920ee28f2c81', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a9c0738d-260b-411e-aba8-920ee28f2c81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '69332659-7906-40a0-86e2-db82762411f1'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:26:32.731870 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-e4ea9c42-f521-40f5-82e6-917431447a11 req-7efd1c6a-d3d3-455a-ba62-bb681fffd377 tempest-TestVolumeBootPattern-1530501963 None] attachment_update completed successfully. Feb 12 21:26:34.868061 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] Created reservations ['020a86cd-85d8-4453-986a-9fa3304fd32c', '4aa3034a-7ebb-4c3b-a8e3-b6cd15a908cb', '198f8be2-00e8-42ed-932c-88dade18a9ac', 'afa8152e-b618-4d8f-9598-568806d412a0'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:26:35.092732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:35.184302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:35.275191 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:26:35.282638 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] Deleted volume successfully. Feb 12 21:26:35.367838 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8261e8d0-356e-4a46-b76e-d133e2c219a0 tempest-AbsoluteLimitsTests-451389352 None] Lock "b'cinder-9ceb3038-56ae-4849-ae5c-519aa20fe8fd-delete_volume'" released by "delete_volume" :: held 4.903s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:26:48.047393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:26:48.051117 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:26:48.051608 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:26:48.072919 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Flow 'volume_create_manager' (1bf92c14-eb93-4de8-b52d-01b151684285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:48.082345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a284221-1be2-4d59-b800-5bfe3f8d6022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:48.089501 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:26:48.107317 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a284221-1be2-4d59-b800-5bfe3f8d6022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-934083672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9aeda77-0335-473a-9462-2f4037b59a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67268b7cb701423a97c6d14f1de05645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:26:48Z,use_quota=True,user_id='fc64bc14eb984bba9687128d14ac1f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:48.113762 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48992426-bac2-4214-92e1-1f6ccc70653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:48.118401 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48992426-bac2-4214-92e1-1f6ccc70653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:48.125149 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b56a09-a465-45ee-a9bc-940a265d6d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:48.130064 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b56a09-a465-45ee-a9bc-940a265d6d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9aeda77-0335-473a-9462-2f4037b59a24', 'volume_name': 'volume-f9aeda77-0335-473a-9462-2f4037b59a24', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:48.135376 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75462b59-313b-4ed7-be76-951c7df2750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:48.141290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75462b59-313b-4ed7-be76-951c7df2750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:48.146850 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc0e337-b96c-46e9-b1a7-2e8d922e2716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:48.148682 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Volume f9aeda77-0335-473a-9462-2f4037b59a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9aeda77-0335-473a-9462-2f4037b59a24', 'volume_size': 1} Feb 12 21:26:48.149540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] creating volume 'volume-f9aeda77-0335-473a-9462-2f4037b59a24' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:26:48.150738 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:48.718013 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:26:48.718980 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:26:48.724679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc0e337-b96c-46e9-b1a7-2e8d922e2716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9aeda77-0335-473a-9462-2f4037b59a24', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:48.741907 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac8120b-dd34-48de-8e6d-484c006a6549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:26:48.903417 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Volume volume-f9aeda77-0335-473a-9462-2f4037b59a24 (f9aeda77-0335-473a-9462-2f4037b59a24): created successfully Feb 12 21:26:48.908755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac8120b-dd34-48de-8e6d-484c006a6549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:26:48.913214 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Flow 'volume_create_manager' (1bf92c14-eb93-4de8-b52d-01b151684285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:26:49.007102 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5ac83351-20fe-4467-a3e1-66982243d7c6 tempest-VolumesActionsTest-2082612410 None] Created volume successfully. Feb 12 21:26:51.749716 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-b7f52a3b-493c-4551-b6ff-e745e56e489c tempest-TestVolumeBootPattern-1530501963 None] Terminate volume connection completed successfully. Feb 12 21:26:51.750921 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-b7f52a3b-493c-4551-b6ff-e745e56e489c tempest-TestVolumeBootPattern-1530501963 None] Deleting attachment 69332659-7906-40a0-86e2-db82762411f1. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:26:52.237939 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-a9c0738d-260b-411e-aba8-920ee28f2c81-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:26:52.450926 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:52.731761 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:26:52.919826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] deleting rbd volume volume-a9c0738d-260b-411e-aba8-920ee28f2c81 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:26:56.989167 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['3603e94c-c00b-4874-af83-90e77f4c6519', '34ce64d0-aed6-447c-8d79-222ae5155ff7', 'e5f74944-5859-4130-b2ab-53dd8d3df082', '1ec86ec4-eb3f-4972-8429-5823b4663a72'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:26:57.201936 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:57.267079 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:57.327332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:26:57.332293 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] Deleted volume successfully. Feb 12 21:26:57.411249 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-779a1cfb-745c-4ede-b7c3-963c30e965dd req-7659879e-a07b-408a-95bf-9bba1f3c1dc0 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-a9c0738d-260b-411e-aba8-920ee28f2c81-delete_volume'" released by "delete_volume" :: held 5.171s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:26:58.283389 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-38fda3b4-afd4-47bb-ab02-6f9a19442050 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-5fef39ac-97f4-4395-ab0f-a44a2e3c59e5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:26:58.288419 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-38fda3b4-afd4-47bb-ab02-6f9a19442050 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:26:59.147316 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a346c920-a573-4110-a343-de248e3c26e2 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['70d7460a-182c-4e51-acb5-0b75d5674b2f', 'c8bbdb64-00ce-4db9-9ac9-268065336a0c', '444e952a-2a68-4ca1-8e3e-83217a61326f', 'c208cecf-6310-4706-a5b8-a527636c07ba'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:26:59.348942 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e5315dd-85c7-44e3-9dbb-5254ced06022 tempest-GroupSnapshotsTest-1517788384 None] Group tempest-GroupSnapshotsTest-Group-570626300: creating Feb 12 21:26:59.519701 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a346c920-a573-4110-a343-de248e3c26e2 tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:26:59.528848 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a346c920-a573-4110-a343-de248e3c26e2 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-7f6ee831-ccad-4acf-9806-42cc856ddd40-delete_snapshot'" released by "delete_snapshot" :: held 31.743s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:26:59.629273 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e5315dd-85c7-44e3-9dbb-5254ced06022 tempest-GroupSnapshotsTest-1517788384 None] Group tempest-GroupSnapshotsTest-Group-570626300: created successfully Feb 12 21:26:59.649666 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e5315dd-85c7-44e3-9dbb-5254ced06022 tempest-GroupSnapshotsTest-1517788384 None] Create group completed successfully. Feb 12 21:27:01.332225 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-38fda3b4-afd4-47bb-ab02-6f9a19442050 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['9c7ef224-8ae3-4979-bd9e-5453351e8fc5', 'be3342ff-a9e6-412c-8479-a61b6ab2fcfc', '74ebea2b-d155-45a6-8aa3-1c4ef0ab0b19', '1b4e845d-5a85-4d04-85fd-69048c576e6f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:01.713033 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-38fda3b4-afd4-47bb-ab02-6f9a19442050 tempest-TestVolumeBootPattern-1530501963 None] Delete snapshot completed successfully. Feb 12 21:27:01.718875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-38fda3b4-afd4-47bb-ab02-6f9a19442050 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-5fef39ac-97f4-4395-ab0f-a44a2e3c59e5-delete_snapshot'" released by "delete_snapshot" :: held 3.440s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:01.742732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:01.750247 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:01.751551 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:01.803108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (ddef8d19-b79e-47aa-ae97-2aade9a766a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:01.822429 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6469b3-6b1f-416c-abef-69ab181cda7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:01.846575 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:01.864126 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6469b3-6b1f-416c-abef-69ab181cda7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790823239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338dee3698c944ca8240d48553a4e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:02Z,use_quota=True,user_id='580ae0f6575f42b49aa02349ba5c95b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:01.869607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce9d51-0b83-4378-a4c2-c2dcd73b5cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:01.873963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fce9d51-0b83-4378-a4c2-c2dcd73b5cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:01.879140 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2367150-1e9a-42f3-a79b-49b269682675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:01.883391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2367150-1e9a-42f3-a79b-49b269682675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a', 'volume_name': 'volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:01.889309 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9b39e7-6dff-4b1c-852a-7be5ca55b575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:01.893868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9b39e7-6dff-4b1c-852a-7be5ca55b575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:01.901458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2f9d1b-3d3a-429a-9a4d-bba6f5f3b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:01.901458 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Volume 6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a', 'volume_size': 1} Feb 12 21:27:01.901458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] creating volume 'volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:01.902127 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:02.080102 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:02.113971 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:02.115028 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:02.145010 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (d447e6ae-77b7-48b8-881e-8fe01fc75383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:02.151890 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3cc33d-224e-4d67-a6f1-a688925a5542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:02.159823 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:02.191359 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3cc33d-224e-4d67-a6f1-a688925a5542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-696869905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87a4d3cb-4e7b-421a-bc76-28f9633b9cc4,host='ncdv-master-1@ceph#ceph',id=8d6b7a95-1266-452c-b9c6-47543a4b59a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50b61007dcc4095b1d17314f9888739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:02Z,use_quota=True,user_id='9fbb5412cd7244d1ac9b6f45073b35f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eb38f58-aba0-4d2c-b17c-f9d449e9823a),volume_type_id=7eb38f58-aba0-4d2c-b17c-f9d449e9823a)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:02.205771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273f1521-2893-4c59-8a5b-5df106bfbbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:02.213436 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273f1521-2893-4c59-8a5b-5df106bfbbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:02.230824 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61b7e8c-9ef8-47df-9494-7a6bc205c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:02.236074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61b7e8c-9ef8-47df-9494-7a6bc205c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6b7a95-1266-452c-b9c6-47543a4b59a5', 'volume_name': 'volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:02.253120 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bae83f-8a7d-498a-b54c-d11f8216576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:02.268497 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bae83f-8a7d-498a-b54c-d11f8216576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:02.274217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06abdc47-b71c-4fb3-987b-d583b323ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:02.275837 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Volume 8d6b7a95-1266-452c-b9c6-47543a4b59a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5', 'volume_size': 1} Feb 12 21:27:02.276456 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] creating volume 'volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:02.277665 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:02.432961 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-f7535b9c-996d-401e-b1d6-de45b2e5c06a req-fec45fe4-3574-4c53-b50c-403606fa9b8f tempest-VolumesSnapshotTestJSON-1959179807 None] Terminate volume connection completed successfully. Feb 12 21:27:02.434278 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-f7535b9c-996d-401e-b1d6-de45b2e5c06a req-fec45fe4-3574-4c53-b50c-403606fa9b8f tempest-VolumesSnapshotTestJSON-1959179807 None] Deleting attachment c5178d8b-0ca4-47f4-9e8e-ba8b5da50dca. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:27:02.643825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-868e717f-5935-4484-a35f-45e4f9eaac9f-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:02.660366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:02.660741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:02.669729 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2f9d1b-3d3a-429a-9a4d-bba6f5f3b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:02.682790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfa1edf-9cec-4cfe-8546-2356763de94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:02.830178 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Volume volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a (6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a): created successfully Feb 12 21:27:02.840005 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfa1edf-9cec-4cfe-8546-2356763de94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:02.853106 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (ddef8d19-b79e-47aa-ae97-2aade9a766a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:02.887679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:03.051338 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:03.298603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] deleting rbd volume volume-868e717f-5935-4484-a35f-45e4f9eaac9f {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:03.310773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:03.311148 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:03.315051 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06abdc47-b71c-4fb3-987b-d583b323ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:03.336540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2aaaa50-28c3-43bd-bc27-ff95b1a47a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:03.336540 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c53e891c-4fc5-46ed-9df3-ca36a94c1c09 tempest-VolumesActionsTest-662775030 None] Created volume successfully. Feb 12 21:27:03.573295 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Volume volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5 (8d6b7a95-1266-452c-b9c6-47543a4b59a5): created successfully Feb 12 21:27:03.578546 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2aaaa50-28c3-43bd-bc27-ff95b1a47a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:03.584383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (d447e6ae-77b7-48b8-881e-8fe01fc75383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:03.670287 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f277561a-c697-4948-aace-e99ea7b3834a tempest-GroupSnapshotsTest-1517788384 None] Created volume successfully. Feb 12 21:27:03.925813 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-da49113b-edef-4753-9e9f-7fc94226ded4 tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a'" acquired by "attach_volume" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:04.171644 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da49113b-edef-4753-9e9f-7fc94226ded4 tempest-VolumesActionsTest-662775030 None] Attaching volume 6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a to instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096 at mountpoint /dev/sdb on host None. Feb 12 21:27:04.374007 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da49113b-edef-4753-9e9f-7fc94226ded4 tempest-VolumesActionsTest-662775030 None] Attach volume completed successfully. Feb 12 21:27:04.381893 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-da49113b-edef-4753-9e9f-7fc94226ded4 tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a'" released by "attach_volume" :: held 0.453s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:04.658551 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d493b370-713e-45cd-83df-dea055e825bd tempest-GroupSnapshotsTest-1517788384 None] GroupSnapshot 30678b48-f5ab-44e2-83a5-19133bd51d81: creating. Feb 12 21:27:04.708744 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d493b370-713e-45cd-83df-dea055e825bd tempest-GroupSnapshotsTest-1517788384 None] Group snapshot 30678b48-f5ab-44e2-83a5-19133bd51d81: creating. {{(pid=134690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 12 21:27:04.741023 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d493b370-713e-45cd-83df-dea055e825bd tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:05.127619 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da082b16-f575-4a91-a482-d3d9fc0ffe9b tempest-VolumesActionsTest-87327096 None] Terminate volume connection completed successfully. Feb 12 21:27:05.168948 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-da082b16-f575-4a91-a482-d3d9fc0ffe9b tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:05.185386 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da082b16-f575-4a91-a482-d3d9fc0ffe9b tempest-VolumesActionsTest-87327096 None] Detaching volume 6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a from instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096. Feb 12 21:27:05.405414 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-da082b16-f575-4a91-a482-d3d9fc0ffe9b tempest-VolumesActionsTest-87327096 None] Detach volume completed successfully. Feb 12 21:27:05.410362 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-da082b16-f575-4a91-a482-d3d9fc0ffe9b tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a-detach_volume'" released by "detach_volume" :: held 0.242s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:05.602615 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-618c6910-9b73-42f9-abc7-f8d7f5173d70 tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:05.603219 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-618c6910-9b73-42f9-abc7-f8d7f5173d70 tempest-VolumesActionsTest-662775030 None] Volume detach called, but volume not attached. Feb 12 21:27:05.691564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-618c6910-9b73-42f9-abc7-f8d7f5173d70 tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a-detach_volume'" released by "detach_volume" :: held 0.089s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:06.474490 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-687efc90-5bc5-4523-8380-7cfe41d79880 tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24'" acquired by "attach_volume" :: waited 0.016s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:06.667456 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-687efc90-5bc5-4523-8380-7cfe41d79880 tempest-VolumesActionsTest-2082612410 None] Attaching volume f9aeda77-0335-473a-9462-2f4037b59a24 to instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1 at mountpoint /dev/sdb on host None. Feb 12 21:27:06.784812 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-687efc90-5bc5-4523-8380-7cfe41d79880 tempest-VolumesActionsTest-2082612410 None] Attach volume completed successfully. Feb 12 21:27:06.795070 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-687efc90-5bc5-4523-8380-7cfe41d79880 tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24'" released by "attach_volume" :: held 0.325s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:06.916301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-3fb3b8e7-e391-4854-92aa-52c5dff7273a tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:06.916770 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3fb3b8e7-e391-4854-92aa-52c5dff7273a tempest-VolumesActionsTest-2082612410 None] Detaching volume f9aeda77-0335-473a-9462-2f4037b59a24 from instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1. Feb 12 21:27:07.117699 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3fb3b8e7-e391-4854-92aa-52c5dff7273a tempest-VolumesActionsTest-2082612410 None] Detach volume completed successfully. Feb 12 21:27:07.125877 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-3fb3b8e7-e391-4854-92aa-52c5dff7273a tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24-detach_volume'" released by "detach_volume" :: held 0.209s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:07.767133 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:27:08.019052 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] deleting parent snapshot volume-868e717f-5935-4484-a35f-45e4f9eaac9f.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:27:10.058299 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-761ef1c6-5e9f-4e49-9573-67706d9cef49 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:10.351137 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['143289e4-ea46-4b7b-8730-80855516d095', 'ec458ff6-cfd1-4998-ab9c-ecc69c418700', '412ec841-20b2-4cfe-8932-b08886b6e2a1', '5f0772d1-803c-4e55-b5e7-926965d25237'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:10.646851 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:10.692656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:10.734137 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:27:10.741911 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] Deleted volume successfully. Feb 12 21:27:10.837072 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-970bde11-d2ba-4bdf-8a36-ba96860b0175 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-868e717f-5935-4484-a35f-45e4f9eaac9f-delete_volume'" released by "delete_volume" :: held 8.198s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:10.916426 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d493b370-713e-45cd-83df-dea055e825bd tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 30678b48-f5ab-44e2-83a5-19133bd51d81: created successfully Feb 12 21:27:11.794473 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:11.800140 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:11.800585 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:11.837568 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (6f6badb0-7f2a-4d03-bee9-e856238bfc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:11.845119 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155dfcd7-b6db-4f76-bd84-b3aa73463ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:11.852233 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:11.872633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155dfcd7-b6db-4f76-bd84-b3aa73463ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-259105546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338dee3698c944ca8240d48553a4e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:11Z,use_quota=True,user_id='580ae0f6575f42b49aa02349ba5c95b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:11.878335 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5937b04-143f-4916-aff2-a153866f963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:11.882871 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5937b04-143f-4916-aff2-a153866f963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:11.888332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b930e91c-392b-4ec6-bcb3-251e68dce4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:11.892603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b930e91c-392b-4ec6-bcb3-251e68dce4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff', 'volume_name': 'volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:11.898062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40db4431-ac63-4ee7-af73-ae9441f4d405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:11.902161 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40db4431-ac63-4ee7-af73-ae9441f4d405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:11.907577 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895aa797-fd38-493e-b280-815af50513b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:11.908628 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Volume 3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff', 'volume_size': 1} Feb 12 21:27:11.909175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] creating volume 'volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:11.910191 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:12.355266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-891ce398-8f19-4ed9-9c26-273ce3a4cf05 tempest-GroupSnapshotsTest-1517788384 None] cloning volumes/volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5@snapshot-65b815d2-eaf2-48ee-ab70-d9d93c3929da to volume-3f6427f7-faf7-4050-abcc-6fc0d1c86aee {{(pid=134690) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 12 21:27:12.357608 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-891ce398-8f19-4ed9-9c26-273ce3a4cf05 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:12.467368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-891ce398-8f19-4ed9-9c26-273ce3a4cf05 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:12.675986 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:12.679351 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:12.679827 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:12.699434 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (c190e51a-a6c7-4528-b4b1-9c1930f0aa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:12.706843 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6654c99-d30c-46e9-b2c4-9ad6eb18c048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:12.714583 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:12.730606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6654c99-d30c-46e9-b2c4-9ad6eb18c048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1146367401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec995a3e-38b5-4860-a73f-89108774c4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11b938ee814f3180aa6e0f37c4e1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:13Z,use_quota=True,user_id='cc56a9a0488e44d7935295ed39bfbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:12.737372 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afd0b23-fb22-4262-ada4-39623d42c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:12.741771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afd0b23-fb22-4262-ada4-39623d42c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:12.747195 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbdea6e-a8e5-440a-adf7-ca0568854390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:12.850227 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbdea6e-a8e5-440a-adf7-ca0568854390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec995a3e-38b5-4860-a73f-89108774c4bf', 'volume_name': 'volume-ec995a3e-38b5-4860-a73f-89108774c4bf', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:12.859529 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17530d4d-3eb3-4319-b103-cc1b7f909886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:12.864546 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17530d4d-3eb3-4319-b103-cc1b7f909886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:12.874727 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848e4849-beed-40bf-978d-d17982929b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:12.876760 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Volume ec995a3e-38b5-4860-a73f-89108774c4bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec995a3e-38b5-4860-a73f-89108774c4bf', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:27:12.877632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Cloning ec995a3e-38b5-4860-a73f-89108774c4bf from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:27:12.900002 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:12.984139 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 27, 12, 916627)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:27:12.985749 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:27:12.986065 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:27:12.994985 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.093s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:12.994985 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:27:13.005272 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 27, 12, 999079)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:27:13.005732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:27:13.006467 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:27:13.032912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:13.400112 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] creating snapshot='volume-ec995a3e-38b5-4860-a73f-89108774c4bf.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:27:14.887116 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-ec995a3e-38b5-4860-a73f-89108774c4bf.clone_snap' to 'volume-ec995a3e-38b5-4860-a73f-89108774c4bf' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:27:14.898181 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:14.902315 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:14.904360 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895aa797-fd38-493e-b280-815af50513b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:14.918333 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de56492-2d80-410b-b18d-4b5b86e300c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:14.972456 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-891ce398-8f19-4ed9-9c26-273ce3a4cf05 tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:14.972832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-891ce398-8f19-4ed9-9c26-273ce3a4cf05 tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:15.044941 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Volume volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff (3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff): created successfully Feb 12 21:27:15.050866 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de56492-2d80-410b-b18d-4b5b86e300c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:15.056558 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (6f6badb0-7f2a-4d03-bee9-e856238bfc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:15.088292 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-761ef1c6-5e9f-4e49-9573-67706d9cef49 tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:27:15.145237 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-dfe464ca-5838-42ca-8e3a-7c28989af10a tempest-VolumesActionsTest-662775030 None] Created volume successfully. Feb 12 21:27:15.337318 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-891ce398-8f19-4ed9-9c26-273ce3a4cf05 tempest-GroupSnapshotsTest-1517788384 None] Create group from source-snapshot-30678b48-f5ab-44e2-83a5-19133bd51d81 completed successfully. Feb 12 21:27:16.025957 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:27:16.027528 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:16.028185 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:16.440328 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:27:16.440328 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Marking volume ec995a3e-38b5-4860-a73f-89108774c4bf as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:27:16.515950 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-17ef081c-95ff-432d-b47a-21d00e7ec9bd tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-1ffe73b8-f41d-4d0e-90cf-e52d2fc23dc6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.062s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:16.517747 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-17ef081c-95ff-432d-b47a-21d00e7ec9bd tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:16.737134 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff-delete_volume'" acquired by "delete_volume" :: waited 0.276s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:16.745941 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to ec995a3e-38b5-4860-a73f-89108774c4bf. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:27:16.747487 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Creating volume glance metadata for volume ec995a3e-38b5-4860-a73f-89108774c4bf backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:27:16.756612 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:17.056971 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:17.247447 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] deleting rbd volume volume-3f6427f7-faf7-4050-abcc-6fc0d1c86aee {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:17.437619 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:17.817090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:17.817526 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] Volume volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:27:18.207408 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] deleting rbd volume volume-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:18.213930 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848e4849-beed-40bf-978d-d17982929b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec995a3e-38b5-4860-a73f-89108774c4bf', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:18.222732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beac9bde-3f64-4701-895a-0f30420736f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:18.377401 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Volume volume-ec995a3e-38b5-4860-a73f-89108774c4bf (ec995a3e-38b5-4860-a73f-89108774c4bf): created successfully Feb 12 21:27:18.381219 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beac9bde-3f64-4701-895a-0f30420736f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:18.386939 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (c190e51a-a6c7-4528-b4b1-9c1930f0aa32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:18.556230 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a12c0da5-4162-4d31-8c66-cc44cf4517c8 tempest-TestVolumeBootPattern-1530501963 None] Created volume successfully. Feb 12 21:27:20.906440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-17ef081c-95ff-432d-b47a-21d00e7ec9bd tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['02f0805b-4a37-4717-b8c7-542f510ac0ca', 'f50bdf1f-e410-4fe2-9063-6b6a42689c8c', 'd5fe2236-4535-4663-adc9-6f6fb706ea90', '03e133db-f6b5-4162-965a-10705436cab5'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:21.200198 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-17ef081c-95ff-432d-b47a-21d00e7ec9bd tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:27:21.205793 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-17ef081c-95ff-432d-b47a-21d00e7ec9bd tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-1ffe73b8-f41d-4d0e-90cf-e52d2fc23dc6-delete_snapshot'" released by "delete_snapshot" :: held 4.690s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:21.997283 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-acd25f7e-ce81-4619-9b60-82802bd2e3b0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:23.786531 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 req-8e1cbe3f-260f-476b-9a83-2d0898c2be18 tempest-TestVolumeBootPattern-1530501963 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:27:24.695255 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 req-8e1cbe3f-260f-476b-9a83-2d0898c2be18 tempest-TestVolumeBootPattern-1530501963 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.908s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:27:24.703343 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 req-8e1cbe3f-260f-476b-9a83-2d0898c2be18 tempest-TestVolumeBootPattern-1530501963 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec995a3e-38b5-4860-a73f-89108774c4bf', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'ec995a3e-38b5-4860-a73f-89108774c4bf', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:27:24.823229 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 req-8e1cbe3f-260f-476b-9a83-2d0898c2be18 tempest-TestVolumeBootPattern-1530501963 None] Connection info returned from driver {'name': 'volumes/volume-ec995a3e-38b5-4860-a73f-89108774c4bf', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ec995a3e-38b5-4860-a73f-89108774c4bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '830c64a6-2a23-4a84-8e67-2586b4cf6e89'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:27:24.984715 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 req-8e1cbe3f-260f-476b-9a83-2d0898c2be18 tempest-TestVolumeBootPattern-1530501963 None] attachment_update completed successfully. Feb 12 21:27:25.069099 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-acd25f7e-ce81-4619-9b60-82802bd2e3b0 tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:27:25.493038 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] Created reservations ['84251185-1dcd-45d5-b1cb-bb05e9862ffc', '140cc9a7-4aea-40c4-a59a-a75f9d1adb77', '271c5a97-06c4-42c1-9833-ce1d353f3080', '0c9388cb-5a69-4d03-a813-26d73e4cc46f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:25.716537 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['07a4f707-519b-4573-82a7-dd1a7e00b1b6'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:25.739473 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2094395678 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2094395678, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:27:25.740202 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2094395678 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2094395678, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:27:25.852946 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:25.945732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:26.012187 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:27:26.015504 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['8374a8e2-8119-4d16-9b39-980db399c20e', 'd907d49e-9033-47a0-8c5f-5ce7270826b9', 'bd0a4611-afa8-4a31-abe5-b55dafc70a1d', 'eef7d58b-59fc-4996-939a-8e2bd26b4ad2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:26.032437 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] Deleted volume successfully. Feb 12 21:27:26.160336 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-ddad116a-2690-4ffe-be19-8a7049205509 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-3cdaa2de-4ef4-4a1a-a5f8-e4cede7661ff-delete_volume'" released by "delete_volume" :: held 9.423s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:26.451313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:26.532191 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:26.606748 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:27:26.610853 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-962ac15c-d08d-4b09-83ce-4c9e9db743c6 tempest-GroupSnapshotsTest-1517788384 None] Delete group completed successfully. Feb 12 21:27:26.705871 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e94af0a-5183-4f9f-bae8-035c8086a949 tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 30678b48-f5ab-44e2-83a5-19133bd51d81: deleting Feb 12 21:27:26.726202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7e94af0a-5183-4f9f-bae8-035c8086a949 tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 30678b48-f5ab-44e2-83a5-19133bd51d81: deleting {{(pid=134690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 12 21:27:26.749122 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7e94af0a-5183-4f9f-bae8-035c8086a949 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:27.089266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:27.096223 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:27.097097 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:27.122965 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (fbd3d2bf-191c-4e65-b7ad-d37a63b5d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:27.130879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206f06cc-1cba-43b7-9bbb-fb821b8f34e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:27.141019 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:27.179471 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206f06cc-1cba-43b7-9bbb-fb821b8f34e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-345603535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4375081-d040-491f-a9f9-f54d8675d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338dee3698c944ca8240d48553a4e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:27Z,use_quota=True,user_id='580ae0f6575f42b49aa02349ba5c95b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:27.191249 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaa3099-b0b5-491e-a437-e76e3999b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:27.197529 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaa3099-b0b5-491e-a437-e76e3999b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:27.204476 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4da009a-ea4c-48d8-8458-e6e98e45d2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:27.209831 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4da009a-ea4c-48d8-8458-e6e98e45d2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4375081-d040-491f-a9f9-f54d8675d16c', 'volume_name': 'volume-b4375081-d040-491f-a9f9-f54d8675d16c', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:27.216812 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f716ca-fdc6-4072-8d3f-2ee2f683c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:27.221114 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f716ca-fdc6-4072-8d3f-2ee2f683c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:27.227429 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874f2f22-ecca-4823-9844-34c2d21d9e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:27.228577 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Volume b4375081-d040-491f-a9f9-f54d8675d16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4375081-d040-491f-a9f9-f54d8675d16c', 'volume_size': 1} Feb 12 21:27:27.229135 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] creating volume 'volume-b4375081-d040-491f-a9f9-f54d8675d16c' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:27.230377 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:27.299892 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bfeba299-28ca-49b1-a210-a058ab5005e0 tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24'" acquired by "attach_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:27.685026 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bfeba299-28ca-49b1-a210-a058ab5005e0 tempest-VolumesActionsTest-2082612410 None] Attaching volume f9aeda77-0335-473a-9462-2f4037b59a24 to instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 at mountpoint /dev/sdb on host None. Feb 12 21:27:27.898566 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bfeba299-28ca-49b1-a210-a058ab5005e0 tempest-VolumesActionsTest-2082612410 None] Attach volume completed successfully. Feb 12 21:27:27.904266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-bfeba299-28ca-49b1-a210-a058ab5005e0 tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24'" released by "attach_volume" :: held 0.608s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:28.139769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0de7bb3a-7896-4684-9f44-ea4d80bc776f tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:28.139769 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0de7bb3a-7896-4684-9f44-ea4d80bc776f tempest-VolumesActionsTest-2082612410 None] Detaching volume f9aeda77-0335-473a-9462-2f4037b59a24 from instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6. Feb 12 21:27:28.434029 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0de7bb3a-7896-4684-9f44-ea4d80bc776f tempest-VolumesActionsTest-2082612410 None] Detach volume completed successfully. Feb 12 21:27:28.439239 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0de7bb3a-7896-4684-9f44-ea4d80bc776f tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24-detach_volume'" released by "detach_volume" :: held 0.301s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:28.597220 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:28.597636 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:28.601634 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874f2f22-ecca-4823-9844-34c2d21d9e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4375081-d040-491f-a9f9-f54d8675d16c', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:28.607270 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3579587-bd51-4ac0-a95c-4640a516cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:28.708619 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Volume volume-b4375081-d040-491f-a9f9-f54d8675d16c (b4375081-d040-491f-a9f9-f54d8675d16c): created successfully Feb 12 21:27:28.712499 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3579587-bd51-4ac0-a95c-4640a516cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:28.719579 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (fbd3d2bf-191c-4e65-b7ad-d37a63b5d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:28.828761 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a02a0b33-e1a8-4e89-888c-bc36802c2333 tempest-VolumesActionsTest-662775030 None] Created volume successfully. Feb 12 21:27:29.318280 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-b4375081-d040-491f-a9f9-f54d8675d16c-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:29.440455 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:29.687520 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:29.687520 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] Volume volume-b4375081-d040-491f-a9f9-f54d8675d16c is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:27:29.872643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] deleting rbd volume volume-b4375081-d040-491f-a9f9-f54d8675d16c {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:31.135564 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-7e94af0a-5183-4f9f-bae8-035c8086a949 tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2094395678 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2094395678, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:27:31.240735 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-7e94af0a-5183-4f9f-bae8-035c8086a949 tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['fccb7de1-d692-49d4-bf9e-b1839f81814d', 'b3d77e18-bf5a-42f0-a5fd-14865f70302a', '4243344a-aeb4-4492-9c1b-af153dcdee30', 'c3b315cd-fcf3-4203-9905-ac5d0ac176fb'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:31.672571 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e94af0a-5183-4f9f-bae8-035c8086a949 tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 30678b48-f5ab-44e2-83a5-19133bd51d81: deleted successfully Feb 12 21:27:32.807244 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:33.152764 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:33.153259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] Volume volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:27:33.439074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] deleting rbd volume volume-8d6b7a95-1266-452c-b9c6-47543a4b59a5 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:36.078654 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-7e16b719-18bf-4940-b46c-75d20e877280 tempest-VolumesActionsTest-2082612410 None] Running cmd (subprocess): rbd export --pool volumes volume-f9aeda77-0335-473a-9462-2f4037b59a24 /opt/stack/data/cinder/conversion/volume-f9aeda77-0335-473a-9462-2f4037b59a24-2a902fc3-8f65-4bc8-bf6a-d7712541b548 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:27:36.963020 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-7e16b719-18bf-4940-b46c-75d20e877280 tempest-VolumesActionsTest-2082612410 None] CMD "rbd export --pool volumes volume-f9aeda77-0335-473a-9462-2f4037b59a24 /opt/stack/data/cinder/conversion/volume-f9aeda77-0335-473a-9462-2f4037b59a24-2a902fc3-8f65-4bc8-bf6a-d7712541b548 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.884s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:27:36.972027 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.image_utils [None req-7e16b719-18bf-4940-b46c-75d20e877280 tempest-VolumesActionsTest-2082612410 None] 2a902fc3-8f65-4bc8-bf6a-d7712541b548 was raw, no need to convert to raw {{(pid=134690) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Feb 12 21:27:36.983866 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] Created reservations ['694db32c-c02a-48c2-9c2e-1fa1f3575214', 'e64d9844-1d19-4a1f-834c-bc53fd459f94', 'dfde2566-2cde-4349-93f8-6989d380b31e', '679b3bc2-bc89-43af-92ad-507ce7bf9df9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:37.172884 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:37.239460 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:37.308299 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:27:37.323736 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] Deleted volume successfully. Feb 12 21:27:37.399995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-46c3370b-3159-4d83-88d3-a4028ff8c010 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-b4375081-d040-491f-a9f9-f54d8675d16c-delete_volume'" released by "delete_volume" :: held 8.081s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:39.516770 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['29600333-63fa-4030-b41c-161fd2b93c6c'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:39.554438 ncdv-master-1 cinder-volume[134690]: WARNING cinder.db.sqlalchemy.api [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2094395678'] Feb 12 21:27:39.657455 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['7513c936-48f6-47f4-ab20-fe7eb259ece3', 'cf2d284e-0866-47df-b171-a333822c6915', '90a860e4-ff08-48fd-91da-6d9e7e7d19ef', 'ede3c79e-0f83-4245-a3ed-915a67aada3d'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:39.750858 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:39.760247 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:39.760747 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:39.798809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (0e0d7487-e46d-43c1-9343-b7cb3006f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:39.807399 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f091d6c-0b6b-4d12-a079-64874c74c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:39.820343 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:39.860300 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f091d6c-0b6b-4d12-a079-64874c74c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808375713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa2419ea-5c89-4349-b388-2500b3f72fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338dee3698c944ca8240d48553a4e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:39Z,use_quota=True,user_id='580ae0f6575f42b49aa02349ba5c95b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:39.873728 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67e7e1a-ecec-4754-9cfc-0526dcf84c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:39.882424 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67e7e1a-ecec-4754-9cfc-0526dcf84c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:39.888423 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9ea05c-0fa8-4548-920e-330910b22095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:39.908592 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9ea05c-0fa8-4548-920e-330910b22095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2419ea-5c89-4349-b388-2500b3f72fb3', 'volume_name': 'volume-aa2419ea-5c89-4349-b388-2500b3f72fb3', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:39.919818 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461e729b-a455-4007-b8b1-89810c4aa870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:39.959332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461e729b-a455-4007-b8b1-89810c4aa870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:39.959332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d295da6-9b5c-4c52-b7d5-51906c79377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:39.959332 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Volume aa2419ea-5c89-4349-b388-2500b3f72fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2419ea-5c89-4349-b388-2500b3f72fb3', 'volume_size': 1} Feb 12 21:27:39.959332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] creating volume 'volume-aa2419ea-5c89-4349-b388-2500b3f72fb3' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:39.959332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:40.155980 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 req-31b5258d-80d8-49ec-b8ed-4c0c79bdfd7a tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:40.673703 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:40.678015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:40.696786 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d295da6-9b5c-4c52-b7d5-51906c79377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2419ea-5c89-4349-b388-2500b3f72fb3', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:40.713398 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb06892-bb31-445a-812e-ad3c8f4afc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:40.737729 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:40.806942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:40.845036 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:27:40.850397 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ce011400-2cc0-43b5-a9b5-63608a3c55d4 tempest-GroupSnapshotsTest-1517788384 None] Delete group completed successfully. Feb 12 21:27:40.852972 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Volume volume-aa2419ea-5c89-4349-b388-2500b3f72fb3 (aa2419ea-5c89-4349-b388-2500b3f72fb3): created successfully Feb 12 21:27:40.857632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb06892-bb31-445a-812e-ad3c8f4afc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:40.863830 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (0e0d7487-e46d-43c1-9343-b7cb3006f40e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:40.924200 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0bd33db0-dce0-48af-a1fe-5e2df0a4ac37 tempest-VolumesActionsTest-662775030 None] Created volume successfully. Feb 12 21:27:42.164846 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-aa2419ea-5c89-4349-b388-2500b3f72fb3-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:42.315157 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:42.559450 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:42.559908 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] Volume volume-aa2419ea-5c89-4349-b388-2500b3f72fb3 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:27:42.751025 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] deleting rbd volume volume-aa2419ea-5c89-4349-b388-2500b3f72fb3 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:43.036008 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c679161e-1462-4698-ac0e-4b94ea0baa27 tempest-GroupSnapshotsTest-1517788384 None] Group tempest-GroupSnapshotsTest-Group-1380996669: creating Feb 12 21:27:43.138095 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c679161e-1462-4698-ac0e-4b94ea0baa27 tempest-GroupSnapshotsTest-1517788384 None] Group tempest-GroupSnapshotsTest-Group-1380996669: created successfully Feb 12 21:27:43.151383 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c679161e-1462-4698-ac0e-4b94ea0baa27 tempest-GroupSnapshotsTest-1517788384 None] Create group completed successfully. Feb 12 21:27:43.456880 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 req-31b5258d-80d8-49ec-b8ed-4c0c79bdfd7a tempest-TestVolumeBootPattern-1530501963 None] Create snapshot completed successfully Feb 12 21:27:44.259396 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 req-e4bbc32e-4a4d-4e01-9c22-9fa6ce39f940 tempest-VolumesSnapshotTestJSON-1959179807 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:27:45.432352 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:45.442862 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:45.444893 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:45.467101 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (085d43a2-ab08-4475-a57a-8297b6eac055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:45.476068 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeb75c8-8958-429b-ac36-6f42ac4d2e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:45.483609 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:45.501013 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeb75c8-8958-429b-ac36-6f42ac4d2e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1461604259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b73d6f4e-7a34-419a-99e2-64107d44bf21,host='ncdv-master-1@ceph#ceph',id=92e1aca8-7269-4b62-af09-c66311f0ac0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50b61007dcc4095b1d17314f9888739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:45Z,use_quota=True,user_id='9fbb5412cd7244d1ac9b6f45073b35f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bd2087e-5116-40bc-8dc4-6db73df65260),volume_type_id=6bd2087e-5116-40bc-8dc4-6db73df65260)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:45.508230 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b233d0b7-155c-43c3-ac78-d525c9d3c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:45.513991 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b233d0b7-155c-43c3-ac78-d525c9d3c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:45.520403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d8b686-e194-4914-b38b-96fd55f0be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:45.525476 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d8b686-e194-4914-b38b-96fd55f0be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e1aca8-7269-4b62-af09-c66311f0ac0f', 'volume_name': 'volume-92e1aca8-7269-4b62-af09-c66311f0ac0f', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:45.531900 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cf6712-e8c7-4fd8-870a-76d778a7ab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:45.536015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69cf6712-e8c7-4fd8-870a-76d778a7ab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:45.541146 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed69887-71c9-42f1-9cc9-5038500ecdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:45.542360 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Volume 92e1aca8-7269-4b62-af09-c66311f0ac0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e1aca8-7269-4b62-af09-c66311f0ac0f', 'volume_size': 1} Feb 12 21:27:45.542773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] creating volume 'volume-92e1aca8-7269-4b62-af09-c66311f0ac0f' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:45.544571 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:45.743748 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 req-e4bbc32e-4a4d-4e01-9c22-9fa6ce39f940 tempest-VolumesSnapshotTestJSON-1959179807 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.485s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:27:45.758181 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 req-e4bbc32e-4a4d-4e01-9c22-9fa6ce39f940 tempest-VolumesSnapshotTestJSON-1959179807 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:27:45.913987 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 req-e4bbc32e-4a4d-4e01-9c22-9fa6ce39f940 tempest-VolumesSnapshotTestJSON-1959179807 None] Connection info returned from driver {'name': 'volumes/volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d0f4abb-5903-44b8-87d3-462cd29d1ffe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '90677f1d-70d0-477c-a142-a02d459c2e04'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:27:46.108097 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 req-e4bbc32e-4a4d-4e01-9c22-9fa6ce39f940 tempest-VolumesSnapshotTestJSON-1959179807 None] attachment_update completed successfully. Feb 12 21:27:46.625239 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:46.626363 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:46.638272 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed69887-71c9-42f1-9cc9-5038500ecdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e1aca8-7269-4b62-af09-c66311f0ac0f', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:46.651021 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04945f91-cbd7-4fb7-ac3f-11e2833ba47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:46.718555 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Volume volume-92e1aca8-7269-4b62-af09-c66311f0ac0f (92e1aca8-7269-4b62-af09-c66311f0ac0f): created successfully Feb 12 21:27:46.724503 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04945f91-cbd7-4fb7-ac3f-11e2833ba47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:46.731823 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (085d43a2-ab08-4475-a57a-8297b6eac055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:46.806259 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-bad38067-fe09-4a15-bdca-ce697077c81e tempest-GroupSnapshotsTest-1517788384 None] Created volume successfully. Feb 12 21:27:49.160010 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:49.183209 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:49.184982 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:49.227988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (f5e91cc3-b5ac-4fec-a566-230cca7a6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:49.234786 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370598e7-ec02-4512-b21d-f487ba006473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:49.264328 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:49.307707 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370598e7-ec02-4512-b21d-f487ba006473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-981616447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b73d6f4e-7a34-419a-99e2-64107d44bf21,host='ncdv-master-1@ceph#ceph',id=d2622ff1-fb47-49bf-97cf-eea7663e6b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50b61007dcc4095b1d17314f9888739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:49Z,use_quota=True,user_id='9fbb5412cd7244d1ac9b6f45073b35f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bd2087e-5116-40bc-8dc4-6db73df65260),volume_type_id=6bd2087e-5116-40bc-8dc4-6db73df65260)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:49.314173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842b6010-175b-4ca9-bbf1-26934722b44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:49.323525 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842b6010-175b-4ca9-bbf1-26934722b44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:49.330711 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5498c5ee-e954-469e-adad-9d484e25e7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:49.337344 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5498c5ee-e954-469e-adad-9d484e25e7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2622ff1-fb47-49bf-97cf-eea7663e6b44', 'volume_name': 'volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:49.344884 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087f9669-89b9-4189-8da7-956b962b07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:49.350510 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087f9669-89b9-4189-8da7-956b962b07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:49.360771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb38adb2-beca-4321-84a0-5308180ce77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:49.360771 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Volume d2622ff1-fb47-49bf-97cf-eea7663e6b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44', 'volume_size': 1} Feb 12 21:27:49.360771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] creating volume 'volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:49.360771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:49.671256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] Created reservations ['13e5a7d3-24ec-49b3-8082-9d594f470819', '363cd224-951f-4ae4-8e6f-dd58c63e17cc', '8325ee5c-a9e4-401c-b052-ccb12a7dac68', '86acc39e-ee59-464f-93c8-f6a3cbc244a6'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:27:50.138432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:50.162610 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:50.198387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:27:50.202201 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] Deleted volume successfully. Feb 12 21:27:50.223951 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:50.224336 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:50.232810 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb38adb2-beca-4321-84a0-5308180ce77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:50.247937 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9828808-9a08-408d-9576-215a3ab6c54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:50.303019 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-40fdec5b-0a26-4a35-9bc2-80db45fb6f27 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-aa2419ea-5c89-4349-b388-2500b3f72fb3-delete_volume'" released by "delete_volume" :: held 8.138s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:27:50.326702 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Volume volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44 (d2622ff1-fb47-49bf-97cf-eea7663e6b44): created successfully Feb 12 21:27:50.332051 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9828808-9a08-408d-9576-215a3ab6c54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:50.369525 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (f5e91cc3-b5ac-4fec-a566-230cca7a6d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:50.508830 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6a5d1295-e6d4-4ba0-aaf2-8e6e5dcd187d tempest-GroupSnapshotsTest-1517788384 None] Created volume successfully. Feb 12 21:27:50.843203 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fa8a9ae6-ad37-462b-bd1d-c51552cf59dd tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:51.527097 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-44f339fe-19e6-4263-a69e-fe48e48172c0 tempest-GroupSnapshotsTest-1517788384 None] Update group completed successfully. Feb 12 21:27:51.652154 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:51.666397 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:51.692098 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:51.848475 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (3e038a4f-836d-41d3-a025-0bb37c346acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:51.862165 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999991d1-53c2-492a-9c2e-8a323bce84ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:51.877286 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:51.912768 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999991d1-53c2-492a-9c2e-8a323bce84ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:50Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0096ad5-c3df-491f-84d1-2e1e432e14c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11b938ee814f3180aa6e0f37c4e1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48da9167-46c3-4a44-91dc-095e52bb654a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:51Z,use_quota=True,user_id='cc56a9a0488e44d7935295ed39bfbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:51.927732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4477dd30-87bd-47bc-8049-571200bc4670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:51.945239 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4477dd30-87bd-47bc-8049-571200bc4670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:51.952513 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6fdd21-dd2e-48ad-8dad-5a04b9bd0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:51.982167 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6fdd21-dd2e-48ad-8dad-5a04b9bd0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'volume_name': 'volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'volume_size': 1, 'snapshot_id': '48da9167-46c3-4a44-91dc-095e52bb654a'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:51.999410 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ac345c-975d-43db-aad8-ebf4a8272ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.010427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ac345c-975d-43db-aad8-ebf4a8272ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:52.017290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc497fe1-afa0-4a2c-a3a0-28f678788671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.027530 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Volume b0096ad5-c3df-491f-84d1-2e1e432e14c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'volume_size': 1, 'snapshot_id': '48da9167-46c3-4a44-91dc-095e52bb654a'} Feb 12 21:27:52.081157 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] cloning volumes/volume-ec995a3e-38b5-4860-a73f-89108774c4bf@snapshot-48da9167-46c3-4a44-91dc-095e52bb654a to volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6 {{(pid=134690) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 12 21:27:52.082117 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:52.237098 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:52.487384 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:27:52.501216 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:27:52.502016 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:27:52.552731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (5f0e76ea-c615-447c-a014-f52ac463e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:52.569895 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91f0c2c-f82a-4b99-b30a-1a72b908c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.610178 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:27:52.641633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91f0c2c-f82a-4b99-b30a-1a72b908c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334988846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=02e4e32d-fb59-4a42-b16b-2de8432764db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338dee3698c944ca8240d48553a4e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:27:52Z,use_quota=True,user_id='580ae0f6575f42b49aa02349ba5c95b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:52.649528 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b082cdd5-6f43-4021-9fdb-5dce9c67bcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.655366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b082cdd5-6f43-4021-9fdb-5dce9c67bcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:52.663973 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a6438a-c2dc-42a7-8393-54f0df0d8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.673654 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a6438a-c2dc-42a7-8393-54f0df0d8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e4e32d-fb59-4a42-b16b-2de8432764db', 'volume_name': 'volume-02e4e32d-fb59-4a42-b16b-2de8432764db', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:52.681430 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc2147d-3c6a-48ea-8893-a6d612eb3e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.686168 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc2147d-3c6a-48ea-8893-a6d612eb3e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:52.691253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b98835-c44b-41a2-8da8-c658664e9f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:52.696448 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Volume 02e4e32d-fb59-4a42-b16b-2de8432764db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e4e32d-fb59-4a42-b16b-2de8432764db', 'volume_size': 1} Feb 12 21:27:52.696857 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] creating volume 'volume-02e4e32d-fb59-4a42-b16b-2de8432764db' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:27:52.697891 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:52.776878 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d022ef3a-e5f8-4ab2-a8df-7ecbb62276fe tempest-GroupSnapshotsTest-1517788384 None] Update group completed successfully. Feb 12 21:27:53.016233 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-fa8a9ae6-ad37-462b-bd1d-c51552cf59dd tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:27:53.843022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:53.844282 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:53.848391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b98835-c44b-41a2-8da8-c658664e9f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e4e32d-fb59-4a42-b16b-2de8432764db', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:53.860099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8434a51b-e7dd-4148-84c8-aef63a16ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:54.051847 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Volume volume-02e4e32d-fb59-4a42-b16b-2de8432764db (02e4e32d-fb59-4a42-b16b-2de8432764db): created successfully Feb 12 21:27:54.056585 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8434a51b-e7dd-4148-84c8-aef63a16ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:54.064296 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (5f0e76ea-c615-447c-a014-f52ac463e8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:54.172473 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:27:54.173071 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:27:54.255286 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-623884b7-0700-4d11-81ec-e647e1117094 tempest-GroupSnapshotsTest-1517788384 None] Update group completed successfully. Feb 12 21:27:54.256873 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c06c4deb-ffc1-476f-aea2-2b677b0a8511 tempest-VolumesActionsTest-662775030 None] Created volume successfully. Feb 12 21:27:54.264247 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Marking volume b0096ad5-c3df-491f-84d1-2e1e432e14c6 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:27:54.377399 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Copying metadata from snapshot 48da9167-46c3-4a44-91dc-095e52bb654a to b0096ad5-c3df-491f-84d1-2e1e432e14c6. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Feb 12 21:27:54.554011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc497fe1-afa0-4a2c-a3a0-28f678788671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'volume_size': 1, 'snapshot_id': '48da9167-46c3-4a44-91dc-095e52bb654a'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:54.568031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11a78df-68d2-451e-86ea-d70c174e9950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:27:54.683602 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Volume volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6 (b0096ad5-c3df-491f-84d1-2e1e432e14c6): created successfully Feb 12 21:27:54.698380 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11a78df-68d2-451e-86ea-d70c174e9950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:27:54.704941 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (3e038a4f-836d-41d3-a025-0bb37c346acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:27:54.825709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ee9aabcd-1ec6-46f0-ab8c-61bbec3af0e1 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:55.120500 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-76b63ca5-4e53-4f01-82a0-2f11c064dbe0 tempest-TestVolumeBootPattern-1530501963 None] Created volume successfully. Feb 12 21:27:55.172175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-02e4e32d-fb59-4a42-b16b-2de8432764db-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:55.450227 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:56.003656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:27:56.005391 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] Volume volume-02e4e32d-fb59-4a42-b16b-2de8432764db is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:27:56.201172 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] deleting rbd volume volume-02e4e32d-fb59-4a42-b16b-2de8432764db {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:27:56.491278 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ed0c7c49-d849-4171-9083-86136033e8fc tempest-GroupSnapshotsTest-1517788384 None] Update group completed successfully. Feb 12 21:27:58.023961 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ee9aabcd-1ec6-46f0-ab8c-61bbec3af0e1 tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:27:58.302935 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-95221e65-d592-43e2-9e9c-7c51d0497f1d tempest-TestVolumeBootPattern-1530501963 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:27:58.922507 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e99690d-f1c8-4ce2-ad43-f60ece5449ee tempest-GroupSnapshotsTest-1517788384 None] GroupSnapshot 556740cc-47a1-4516-a74e-fd3ee2df7c0a: creating. Feb 12 21:27:58.949097 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7e99690d-f1c8-4ce2-ad43-f60ece5449ee tempest-GroupSnapshotsTest-1517788384 None] Group snapshot 556740cc-47a1-4516-a74e-fd3ee2df7c0a: creating. {{(pid=134690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 12 21:27:59.015635 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7e99690d-f1c8-4ce2-ad43-f60ece5449ee tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:59.426422 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-95221e65-d592-43e2-9e9c-7c51d0497f1d tempest-TestVolumeBootPattern-1530501963 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.124s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:27:59.427303 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-95221e65-d592-43e2-9e9c-7c51d0497f1d tempest-TestVolumeBootPattern-1530501963 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:27:59.484471 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d877bf49-bae4-4cc6-a82d-c852e9b2093d tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-b81cb3d7-92ab-4545-b30a-24e55a57cf1d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.033s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:27:59.486402 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d877bf49-bae4-4cc6-a82d-c852e9b2093d tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:27:59.751563 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-95221e65-d592-43e2-9e9c-7c51d0497f1d tempest-TestVolumeBootPattern-1530501963 None] Connection info returned from driver {'name': 'volumes/volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b0096ad5-c3df-491f-84d1-2e1e432e14c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a2d986b3-4df2-42c3-89a0-43567f2b10f0'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:27:59.890087 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-67465923-a379-4eb2-b59a-16c8c94fa66a req-95221e65-d592-43e2-9e9c-7c51d0497f1d tempest-TestVolumeBootPattern-1530501963 None] attachment_update completed successfully. Feb 12 21:28:04.466803 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] Created reservations ['a03b2e0a-740d-41c7-8df3-193232ef8705', '262f0f45-99f7-4613-8c28-bd750c9e2e16', 'b1d4d27f-448f-489c-8d49-6624affed623', 'f8014b6b-415a-4599-87cb-f9ed99bcb633'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:04.575893 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7e99690d-f1c8-4ce2-ad43-f60ece5449ee tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:05.386253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:05.476630 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:05.580380 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:05.584332 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] Deleted volume successfully. Feb 12 21:28:05.678194 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-86658490-f907-425c-b122-5b7afa45d025 tempest-VolumesActionsTest-87327096 None] Lock "b'cinder-02e4e32d-fb59-4a42-b16b-2de8432764db-delete_volume'" released by "delete_volume" :: held 10.506s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:28:06.824087 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:06.842660 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:06.852238 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:06.913995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (c7c17b25-583f-49fc-a57f-d9bb324921bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:06.931918 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63eaf99f-6e29-4e8d-9fc4-deb0926e84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:06.946835 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:06.970672 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63eaf99f-6e29-4e8d-9fc4-deb0926e84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873049455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cf7b0795-9ea7-4236-a80b-2c4343b06ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='338dee3698c944ca8240d48553a4e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:07Z,use_quota=True,user_id='580ae0f6575f42b49aa02349ba5c95b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:06.977630 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c28eb5-0c2e-4647-b62a-223dfd6116fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:06.982928 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c28eb5-0c2e-4647-b62a-223dfd6116fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:06.988951 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36428ef-35f7-4758-8ae1-cedbb2ef0e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:06.997013 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36428ef-35f7-4758-8ae1-cedbb2ef0e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7b0795-9ea7-4236-a80b-2c4343b06ccf', 'volume_name': 'volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:07.002130 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641e9edf-0740-4057-9408-d822693978b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:07.006952 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641e9edf-0740-4057-9408-d822693978b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:07.012932 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254e23f9-85e0-4b6b-b0aa-46d44870c479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:07.021291 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Volume cf7b0795-9ea7-4236-a80b-2c4343b06ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf', 'volume_size': 1} Feb 12 21:28:07.022134 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] creating volume 'volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:07.024726 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:08.624732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:08.626192 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:08.633053 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254e23f9-85e0-4b6b-b0aa-46d44870c479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:08.644051 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0163364-d0f0-4744-8d48-e484bda3f454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:08.748895 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Volume volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf (cf7b0795-9ea7-4236-a80b-2c4343b06ccf): created successfully Feb 12 21:28:08.760102 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0163364-d0f0-4744-8d48-e484bda3f454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:08.779321 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Flow 'volume_create_manager' (c7c17b25-583f-49fc-a57f-d9bb324921bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:08.918031 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1181d48a-9eb8-4084-af15-9eb0253aeef0 tempest-VolumesActionsTest-662775030 None] Created volume successfully. Feb 12 21:28:09.466631 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e99690d-f1c8-4ce2-ad43-f60ece5449ee tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 556740cc-47a1-4516-a74e-fd3ee2df7c0a: created successfully Feb 12 21:28:10.271349 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 556740cc-47a1-4516-a74e-fd3ee2df7c0a: deleting Feb 12 21:28:10.303630 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 556740cc-47a1-4516-a74e-fd3ee2df7c0a: deleting {{(pid=134690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 12 21:28:10.344228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:11.143533 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:28:11.144268 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:11.235482 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:11.284805 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:11.826937 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aa000721-5540-4bec-88c0-f9ce242522cf tempest-GroupSnapshotsV319Test-513019662 None] Group tempest-GroupSnapshotsV319Test-Group-602810251: creating Feb 12 21:28:11.957178 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aa000721-5540-4bec-88c0-f9ce242522cf tempest-GroupSnapshotsV319Test-513019662 None] Group tempest-GroupSnapshotsV319Test-Group-602810251: created successfully Feb 12 21:28:11.999727 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-cf7b0795-9ea7-4236-a80b-2c4343b06ccf-delete_volume'" acquired by "delete_volume" :: waited 0.053s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:12.008904 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aa000721-5540-4bec-88c0-f9ce242522cf tempest-GroupSnapshotsV319Test-513019662 None] Create group completed successfully. Feb 12 21:28:12.211364 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:12.741720 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:12.741720 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] Volume volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:13.110971 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] deleting rbd volume volume-cf7b0795-9ea7-4236-a80b-2c4343b06ccf {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:13.329862 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7e16b719-18bf-4940-b46c-75d20e877280 tempest-VolumesActionsTest-2082612410 None] Uploaded volume to glance image-id: 2a902fc3-8f65-4bc8-bf6a-d7712541b548. {{(pid=134690) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Feb 12 21:28:13.445231 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7e16b719-18bf-4940-b46c-75d20e877280 tempest-VolumesActionsTest-2082612410 None] Copy volume to image completed successfully. Feb 12 21:28:13.835777 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:13.839388 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:13.840499 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:13.860364 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Flow 'volume_create_manager' (c96c7a3f-4fd0-48dc-b6ac-2bd72af4167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:13.867670 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b659c21-8140-45f2-8cc0-94461b6bb024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:13.874573 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:13.889549 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b659c21-8140-45f2-8cc0-94461b6bb024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1587625297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28d7e7d5-fcca-4ff1-a993-73f43ea4f6dc,host='ncdv-master-1@ceph#ceph',id=17d7c595-1751-448d-82a6-dbba6797bee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc860bfd47441de882fc1306f23ba27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:14Z,use_quota=True,user_id='acc6c963f0c94180a4628723378899fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bac43d3f-b15e-47a1-adc5-f78acc1deaa0),volume_type_id=bac43d3f-b15e-47a1-adc5-f78acc1deaa0)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:13.896533 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee937c5-41ff-4d4c-8a86-a0b96f12039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:13.900834 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee937c5-41ff-4d4c-8a86-a0b96f12039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:13.908957 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c3ade1-968f-490a-9a70-d7ad6ed93782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:13.916763 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c3ade1-968f-490a-9a70-d7ad6ed93782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d7c595-1751-448d-82a6-dbba6797bee6', 'volume_name': 'volume-17d7c595-1751-448d-82a6-dbba6797bee6', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:13.923376 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324a799c-00cf-44e0-bfc7-10408d139cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:13.928929 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324a799c-00cf-44e0-bfc7-10408d139cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:13.935495 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f1c199-f02b-4964-9ad0-f3879fc4c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:13.937480 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Volume 17d7c595-1751-448d-82a6-dbba6797bee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d7c595-1751-448d-82a6-dbba6797bee6', 'volume_size': 1} Feb 12 21:28:13.937931 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] creating volume 'volume-17d7c595-1751-448d-82a6-dbba6797bee6' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:13.939264 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:15.853312 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:15.854567 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:15.859264 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f1c199-f02b-4964-9ad0-f3879fc4c313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d7c595-1751-448d-82a6-dbba6797bee6', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:15.869460 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e5e56f-4795-44a5-ae58-cff474be0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:15.966928 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Volume volume-17d7c595-1751-448d-82a6-dbba6797bee6 (17d7c595-1751-448d-82a6-dbba6797bee6): created successfully Feb 12 21:28:15.973845 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e5e56f-4795-44a5-ae58-cff474be0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:15.990657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Flow 'volume_create_manager' (c96c7a3f-4fd0-48dc-b6ac-2bd72af4167d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:16.036610 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-67f941c8-e889-44a4-b609-4ec087170785 req-3b0dff8e-cf59-4537-a18a-78b2fecfa76e tempest-TestVolumeBootPattern-1530501963 None] Terminate volume connection completed successfully. Feb 12 21:28:16.037015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-67f941c8-e889-44a4-b609-4ec087170785 req-3b0dff8e-cf59-4537-a18a-78b2fecfa76e tempest-TestVolumeBootPattern-1530501963 None] Deleting attachment a2d986b3-4df2-42c3-89a0-43567f2b10f0. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:28:16.134630 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-34d6d101-10a2-4803-8a9c-b80ef35bd1d3 tempest-GroupSnapshotsV319Test-513019662 None] Created volume successfully. Feb 12 21:28:16.217967 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:16.348277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:16.660393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:16.660852 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] Volume volume-f9aeda77-0335-473a-9462-2f4037b59a24 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:16.948068 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] deleting rbd volume volume-f9aeda77-0335-473a-9462-2f4037b59a24 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:16.985493 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:17.368318 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-b0096ad5-c3df-491f-84d1-2e1e432e14c6-delete_volume'" acquired by "delete_volume" :: waited 0.412s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:17.571296 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:18.062512 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:18.534058 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] deleting rbd volume volume-b0096ad5-c3df-491f-84d1-2e1e432e14c6 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:18.538321 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-308789cd-bb7b-4271-b9ad-3e7afe6e9bfd tempest-GroupSnapshotsV319Test-513019662 None] GroupSnapshot c79689a8-e13b-4669-b3ef-821360d43781: creating. Feb 12 21:28:18.562173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-308789cd-bb7b-4271-b9ad-3e7afe6e9bfd tempest-GroupSnapshotsV319Test-513019662 None] Group snapshot c79689a8-e13b-4669-b3ef-821360d43781: creating. {{(pid=134690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 12 21:28:18.579549 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-308789cd-bb7b-4271-b9ad-3e7afe6e9bfd tempest-GroupSnapshotsV319Test-513019662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:23.125866 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] Created reservations ['8dc38bf1-2a73-48fe-be5a-d29ed75d944e', 'cb34d8a0-acc3-4f42-98ac-e61329452494', '776f2d69-9d3e-408e-bb20-f104cbf845a5', '1ac7a890-3eaf-48a1-904d-1c39ae46abb5'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:23.254225 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2020303999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2020303999, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:28:23.254931 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2020303999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2020303999, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:28:23.394894 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-308789cd-bb7b-4271-b9ad-3e7afe6e9bfd tempest-GroupSnapshotsV319Test-513019662 None] group_snapshot c79689a8-e13b-4669-b3ef-821360d43781: created successfully Feb 12 21:28:23.430228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['041d2b62-1821-4bee-bb1c-6ada159e63b3', 'b6f3d3c7-5c67-41c9-ba5e-b0fde629595d', 'c1382bd7-3d12-4362-8cc3-44821fcdeb59', '7b6fa32b-8908-48fb-8381-711da6b670ea'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:23.554544 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:23.617534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:23.802088 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:23.813760 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] Deleted volume successfully. Feb 12 21:28:23.961806 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c2d4da51-77fe-4425-8a3f-ebee6d6abbe6 tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-cf7b0795-9ea7-4236-a80b-2c4343b06ccf-delete_volume'" released by "delete_volume" :: held 11.961s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:28:24.171963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['231e2ce2-d599-460d-b9f5-d6c50c197a01', 'aba6b475-ff54-4e3b-8d65-e9b53380a3f1', '3a3b97eb-7c21-4eb4-a2de-bd5ef07613d2', 'a73c78ff-42e1-4e10-95dd-c1bad4f2c8d4'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:24.275906 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:24.441256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:24.858368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:24.860041 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] Volume volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:25.269681 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] deleting rbd volume volume-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:25.280746 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-513b51cf-9583-495b-867d-9da08f5e30fa tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 556740cc-47a1-4516-a74e-fd3ee2df7c0a: deleted successfully Feb 12 21:28:25.317566 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] group_snapshot c79689a8-e13b-4669-b3ef-821360d43781: deleting Feb 12 21:28:25.365740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:25.622710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:25.626122 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Volume volume-92e1aca8-7269-4b62-af09-c66311f0ac0f is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:25.931073 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] deleting rbd volume volume-92e1aca8-7269-4b62-af09-c66311f0ac0f {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:25.934025 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] group_snapshot c79689a8-e13b-4669-b3ef-821360d43781: deleting {{(pid=134690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 12 21:28:25.975837 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:26.414824 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] Created reservations ['469fcedc-a2e3-492e-9796-e872ecc295cf', '9efe1c95-e8b3-47a8-a4d0-67b331fb4a93', 'aee1f068-f01c-4933-ad0e-69912aeb42d3', 'ce2b33f0-4fde-4ad5-94c7-3c6aa178eda3'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:26.701833 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:26.757719 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:26.805134 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:26.810009 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] Deleted volume successfully. Feb 12 21:28:26.942324 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-99d3ad34-5152-4163-aa0e-b6688fcc0c0a tempest-VolumesActionsTest-2082612410 None] Lock "b'cinder-f9aeda77-0335-473a-9462-2f4037b59a24-delete_volume'" released by "delete_volume" :: held 10.724s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:28:28.384084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['42542be0-7bd9-4d3c-a8d7-f4dfd1e2f329', '9fdfc2cc-f7b5-4a1c-9ae9-0fb7b037d43f', '98097d44-3a10-4327-b4cd-c765b81fe487', 'a36fb3cf-7d4e-4af6-bd62-6e43ceaaf222'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:28.556209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:28.615123 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:28.670531 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:28.684501 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] Deleted volume successfully. Feb 12 21:28:28.804394 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-67f941c8-e889-44a4-b609-4ec087170785 req-2b6c18f7-f0a5-4c41-a9c0-e3b63ba099f4 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-b0096ad5-c3df-491f-84d1-2e1e432e14c6-delete_volume'" released by "delete_volume" :: held 11.435s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:28:28.880959 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c8c0076a-137d-44c9-9b1d-feb70344ada7 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-48da9167-46c3-4a44-91dc-095e52bb654a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:28.882559 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c8c0076a-137d-44c9-9b1d-feb70344ada7 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:30.855950 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1899007777 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1899007777, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:28:30.856908 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1899007777 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1899007777, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:28:30.991912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] Created reservations ['bc427b7b-1069-4642-bb48-d393f27f700f', 'e2b2f995-b690-473e-8afb-5ab5c42db2d6', 'c93e692e-806e-415e-856d-2372dc2a377b', '5d6e7f20-a02d-4e63-b5f7-ba14f3050e32'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:31.155803 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:31.156339 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:31.157011 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:31.193002 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Flow 'volume_create_manager' (07e5f214-60ed-4049-a877-542e6f37bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:31.206040 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c019ea-82eb-421f-b084-dbb1e0e69b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:31.230052 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-d877bf49-bae4-4cc6-a82d-c852e9b2093d tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:31.267569 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c019ea-82eb-421f-b084-dbb1e0e69b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1663666969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26ca82ae-203e-4910-8cdd-d0a1425ce5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a70c35cc73d447eacc7b32dabbae7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:31Z,use_quota=True,user_id='28d91a4daaf74bf88c4a227f8944b7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:31.279337 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913ad60f-b367-4275-a544-48d3c880537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:31.284304 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913ad60f-b367-4275-a544-48d3c880537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:31.290223 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bd8146-ddbc-4c4b-9ae5-6fd77004cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:31.295920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bd8146-ddbc-4c4b-9ae5-6fd77004cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ca82ae-203e-4910-8cdd-d0a1425ce5d4', 'volume_name': 'volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:31.301300 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e89308-6a1e-4eaf-aacd-2a486e18137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:31.305790 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e89308-6a1e-4eaf-aacd-2a486e18137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:31.312557 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f003a1-132f-46ce-bcce-56eac0484614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:31.314667 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Volume 26ca82ae-203e-4910-8cdd-d0a1425ce5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4', 'volume_size': 1} Feb 12 21:28:31.315081 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] creating volume 'volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:31.316379 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:31.445862 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7aff3617-5571-41b8-95b8-ec3128afce5a tempest-GroupSnapshotsV319Test-513019662 None] group_snapshot c79689a8-e13b-4669-b3ef-821360d43781: deleted successfully Feb 12 21:28:31.497160 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d877bf49-bae4-4cc6-a82d-c852e9b2093d tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['b0bdad9c-b7a7-48b8-b7b5-5821e1bc6172', '538a17b6-ef04-44e3-b09d-adf006093e82', '840c36ce-0a71-4b11-895c-23b4b0013f4e', 'c897cc57-5e4c-4f88-86be-181f9e9e8ae4'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:31.748440 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d877bf49-bae4-4cc6-a82d-c852e9b2093d tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:28:31.763749 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d877bf49-bae4-4cc6-a82d-c852e9b2093d tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-b81cb3d7-92ab-4545-b30a-24e55a57cf1d-delete_snapshot'" released by "delete_snapshot" :: held 32.270s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:28:32.318782 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:32.778934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:32.778934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] Volume volume-17d7c595-1751-448d-82a6-dbba6797bee6 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:33.117416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] deleting rbd volume volume-17d7c595-1751-448d-82a6-dbba6797bee6 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:33.128026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:33.128408 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:33.141400 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f003a1-132f-46ce-bcce-56eac0484614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:33.150684 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17709da6-0efe-4a18-86e7-f3fdf9acb1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:33.154919 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0c9b3d32-9fd9-460b-9efc-4413eca4c43f tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-32d37d55-6f14-49f4-8f64-abd6ccdfebe4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.865s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:33.156370 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0c9b3d32-9fd9-460b-9efc-4413eca4c43f tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:33.637574 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Volume volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4 (26ca82ae-203e-4910-8cdd-d0a1425ce5d4): created successfully Feb 12 21:28:33.646717 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17709da6-0efe-4a18-86e7-f3fdf9acb1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:33.648127 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Flow 'volume_create_manager' (07e5f214-60ed-4049-a877-542e6f37bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:33.716966 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9a0a65b6-cba0-4c3d-b082-fb9672c5e641 tempest-VolumesBackupsV39Test-461572751 None] Created volume successfully. Feb 12 21:28:34.046855 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:34.299870 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:34.300417 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Volume volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:34.680902 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] deleting rbd volume volume-d2622ff1-fb47-49bf-97cf-eea7663e6b44 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:34.907777 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] Created reservations ['7ca32c10-ba15-47bd-99f4-9d65c15f379d', '1f8036e4-fa8d-4660-a8bc-a9065df7fbd7', '22788eab-f767-461b-8936-e7cd1c76b710', 'cb916a11-739a-4a94-a7c6-270ac405cf20'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:34.982090 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:28:34Z,data_timestamp=2022-02-12T21:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-2003215460',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=25c83729-fd36-405d-a329-b96511b4e61b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7a70c35cc73d447eacc7b32dabbae7e3',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='28d91a4daaf74bf88c4a227f8944b7d1',volume_id=26ca82ae-203e-4910-8cdd-d0a1425ce5d4) Feb 12 21:28:34.982796 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] continue_backup in rpcapi backup_id 25c83729-fd36-405d-a329-b96511b4e61b {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:28:35.154754 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:35.227290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:35.267632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:35.271752 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] Deleted volume successfully. Feb 12 21:28:35.301310 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:28:35.392474 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-29f3279d-a415-4183-a02a-51642c89554b tempest-VolumesActionsTest-662775030 None] Lock "b'cinder-6b5ae7da-87a2-4682-a5ad-e7ef5ea2583a-delete_volume'" released by "delete_volume" :: held 11.116s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:28:36.172480 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.882s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:28:36.173188 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '26ca82ae-203e-4910-8cdd-d0a1425ce5d4', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:28:36.190545 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] Initialize volume connection completed successfully. Feb 12 21:28:42.794068 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] Created reservations ['b53214df-99e4-46cf-9be7-7254aad51618'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:42.825765 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1899007777 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1899007777, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:28:42.965386 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] Created reservations ['342620e6-3b5b-4276-b916-18486b4bd3ed', '4fc6f838-38a0-4020-9deb-81c11670ea1a', '005ebe7b-7828-4ad7-aca2-f2b9bb05676b', '7abd6e70-2a60-4c03-9db3-2db6a26e2513'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:43.468684 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:43.513387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:43.557484 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:43.567451 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-487443bb-7742-48d8-9354-a3c2210e5913 tempest-GroupSnapshotsV319Test-513019662 None] Delete group completed successfully. Feb 12 21:28:43.948747 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['c7233a39-3515-40fe-b611-5aa7cca3c972'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:43.996382 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2020303999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2020303999, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:28:44.107825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['4345b619-dafa-44c3-9a30-c3b09e809705', 'a5b1a587-8ba6-4af4-ac7c-7231d86eb3d0', '56e63b82-6ca6-453b-96f1-67340ff58a97', 'a053963b-e9b4-478b-aafd-20bc7d610543'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:44.270672 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:44.275029 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:44.275511 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:44.302607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Flow 'volume_create_manager' (45ac6864-6ba8-464b-ae9a-efee2c7cea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:44.313036 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc05f9-d9ef-4469-9240-2828ba87a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:44.320123 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:44.340005 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfc05f9-d9ef-4469-9240-2828ba87a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-540539279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8a8bf3f-b6bb-45ab-9e2b-702888d78c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7799f036b0a49c89167227446bf3dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:44Z,use_quota=True,user_id='d049ac2cbb7944a0b8e03ce7f4889b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:44.345703 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ebc126-1b4f-4d66-8e0a-2afaca7af299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:44.350661 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ebc126-1b4f-4d66-8e0a-2afaca7af299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:44.360290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77543bae-b240-4906-b9e8-7428d3b47bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:44.364698 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77543bae-b240-4906-b9e8-7428d3b47bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a8bf3f-b6bb-45ab-9e2b-702888d78c76', 'volume_name': 'volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:44.371053 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa754298-c9b3-4fcc-a664-0303f8c75fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:44.375452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa754298-c9b3-4fcc-a664-0303f8c75fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:44.381291 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5583a2-c985-4d57-8595-3c7b92fd5493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:44.382982 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Volume f8a8bf3f-b6bb-45ab-9e2b-702888d78c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76', 'volume_size': 1} Feb 12 21:28:44.383384 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] creating volume 'volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:44.384367 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:44.656949 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['ed9e5072-b87f-41eb-8c94-e6c7ce649ebb', 'e8cf7aa1-522b-4430-8a76-4a4b95de90e2', 'fb731f4d-d1d4-4603-9600-a2c0b81c1eda', 'ac01c2ca-9e70-406c-ab9b-31b8ba55d59d'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:28:45.086707 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:45.116476 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:45.177513 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:28:45.183088 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-49cf58bb-1f36-4184-8717-033d565193ff tempest-GroupSnapshotsTest-1517788384 None] Delete group completed successfully. Feb 12 21:28:45.855485 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:45.856141 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:45.861647 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5583a2-c985-4d57-8595-3c7b92fd5493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:45.868606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56a8ac1-0d73-4ce2-b78f-88fb53dd3f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:46.019228 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Volume volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76 (f8a8bf3f-b6bb-45ab-9e2b-702888d78c76): created successfully Feb 12 21:28:46.023298 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56a8ac1-0d73-4ce2-b78f-88fb53dd3f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:46.029854 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Flow 'volume_create_manager' (45ac6864-6ba8-464b-ae9a-efee2c7cea40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:46.098005 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-18d2c8d3-c19d-4a08-a581-fd8a0c780322 tempest-VolumesListAdminTestJSON-954407049 None] Created volume successfully. Feb 12 21:28:46.569931 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] Terminate volume connection completed successfully. Feb 12 21:28:46.590149 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7469b4b1-4b9a-4a5d-b2b1-8968b821a647 tempest-VolumesBackupsV39Test-461572751 None] Remove volume export completed successfully. Feb 12 21:28:46.905845 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7b34a108-1e0c-49a1-a853-f39f3a3e477d tempest-GroupSnapshotsTest-1517788384 None] Group tempest-GroupSnapshotsTest-Group-1751839729: creating Feb 12 21:28:47.016520 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7b34a108-1e0c-49a1-a853-f39f3a3e477d tempest-GroupSnapshotsTest-1517788384 None] Group tempest-GroupSnapshotsTest-Group-1751839729: created successfully Feb 12 21:28:47.078176 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7b34a108-1e0c-49a1-a853-f39f3a3e477d tempest-GroupSnapshotsTest-1517788384 None] Create group completed successfully. Feb 12 21:28:48.294082 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:48.299952 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:48.299952 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:48.345904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Flow 'volume_create_manager' (b3c1156d-a164-4e40-907a-33af6d17578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:48.365874 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68191227-e10b-46ba-800c-9cd4e6137df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:48.383157 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:48.409516 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68191227-e10b-46ba-800c-9cd4e6137df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673907244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a1c7ef7-735c-4ba8-b954-8d6a57433a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7799f036b0a49c89167227446bf3dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:48Z,use_quota=True,user_id='d049ac2cbb7944a0b8e03ce7f4889b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:48.418188 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6780ef65-7b6d-4415-adf1-6bf75f15391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:48.427467 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6780ef65-7b6d-4415-adf1-6bf75f15391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:48.442931 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c6ec46-01b2-4c9c-a58c-f007049b74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:48.447924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c6ec46-01b2-4c9c-a58c-f007049b74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1c7ef7-735c-4ba8-b954-8d6a57433a8d', 'volume_name': 'volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:48.454496 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb1919c-ea48-4b8a-957c-313d4b5bb3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:48.460370 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb1919c-ea48-4b8a-957c-313d4b5bb3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:48.464792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3588b5-3234-4c07-a35d-701c7707f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:48.466209 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Volume 7a1c7ef7-735c-4ba8-b954-8d6a57433a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d', 'volume_size': 1} Feb 12 21:28:48.466824 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] creating volume 'volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:48.468118 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:49.057540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:49.060954 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:49.065586 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:49.080934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (91a64a34-bc45-4b29-8460-54e195761472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:49.087964 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc48862f-da98-4508-b718-ea3e28dbe3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:49.098898 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:49.125087 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc48862f-da98-4508-b718-ea3e28dbe3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-962232379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc87c04-8a1c-4d3a-a4e0-f7ec3545c28e,host='ncdv-master-1@ceph#ceph',id=190a064f-1173-4723-a9f5-23d24dea9652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50b61007dcc4095b1d17314f9888739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:49Z,use_quota=True,user_id='9fbb5412cd7244d1ac9b6f45073b35f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(809935a7-f717-4750-9b7c-7073d685dd56),volume_type_id=809935a7-f717-4750-9b7c-7073d685dd56)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:49.131393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45f9746-62eb-41f7-82ab-adb0572aa743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:49.136350 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45f9746-62eb-41f7-82ab-adb0572aa743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:49.142520 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26e85ac-529d-4e70-9b5b-94722757dba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:49.147110 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26e85ac-529d-4e70-9b5b-94722757dba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190a064f-1173-4723-a9f5-23d24dea9652', 'volume_name': 'volume-190a064f-1173-4723-a9f5-23d24dea9652', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:49.170002 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccfd5e1-8eeb-416d-8f2a-2dd554ff2b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:49.177146 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccfd5e1-8eeb-416d-8f2a-2dd554ff2b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:49.188611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef409ef-ea00-4e9c-8cb8-a865cbf97335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:49.190866 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Volume 190a064f-1173-4723-a9f5-23d24dea9652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190a064f-1173-4723-a9f5-23d24dea9652', 'volume_size': 1} Feb 12 21:28:49.191429 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] creating volume 'volume-190a064f-1173-4723-a9f5-23d24dea9652' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:49.192669 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:49.563878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:49.563878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:49.570395 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3588b5-3234-4c07-a35d-701c7707f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:49.579263 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c182a67e-86fd-44e2-920e-cbe99192c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:49.660188 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Volume volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d (7a1c7ef7-735c-4ba8-b954-8d6a57433a8d): created successfully Feb 12 21:28:49.664093 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c182a67e-86fd-44e2-920e-cbe99192c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:49.670388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Flow 'volume_create_manager' (b3c1156d-a164-4e40-907a-33af6d17578f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:49.742941 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c2138101-c6ee-42f4-b612-c85db25a431f tempest-VolumesListAdminTestJSON-954407049 None] Created volume successfully. Feb 12 21:28:50.168214 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:50.168698 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:50.173726 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef409ef-ea00-4e9c-8cb8-a865cbf97335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190a064f-1173-4723-a9f5-23d24dea9652', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:50.180161 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47093623-c5b5-467f-a00f-97b306ca12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:50.273517 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Volume volume-190a064f-1173-4723-a9f5-23d24dea9652 (190a064f-1173-4723-a9f5-23d24dea9652): created successfully Feb 12 21:28:50.279045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47093623-c5b5-467f-a00f-97b306ca12be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:50.289772 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Flow 'volume_create_manager' (91a64a34-bc45-4b29-8460-54e195761472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:50.404762 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3c40de04-e10b-4531-9f21-0bd3b453b6b5 tempest-GroupSnapshotsTest-1517788384 None] Created volume successfully. Feb 12 21:28:51.343986 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:51.347424 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:51.347886 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:51.404761 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Flow 'volume_create_manager' (c6cb94f4-f953-454b-ae83-935918994df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:51.419688 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af462096-ebff-4cd4-9d66-460dc006d2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:51.436209 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:51.464826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af462096-ebff-4cd4-9d66-460dc006d2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-294945219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b00299d-e343-498a-b3b0-aecb4d3ce031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7799f036b0a49c89167227446bf3dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:51Z,use_quota=True,user_id='d049ac2cbb7944a0b8e03ce7f4889b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:51.474129 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d01ac1-fc73-4d5a-b5fd-a476a403db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:51.479887 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d01ac1-fc73-4d5a-b5fd-a476a403db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:51.485491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df002b8-d5ad-4aed-88f3-eec392f36f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:51.491401 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df002b8-d5ad-4aed-88f3-eec392f36f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b00299d-e343-498a-b3b0-aecb4d3ce031', 'volume_name': 'volume-2b00299d-e343-498a-b3b0-aecb4d3ce031', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:51.499516 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bd0908-111a-4775-93cc-8679e7cdb15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:51.504608 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bd0908-111a-4775-93cc-8679e7cdb15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:51.511980 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6dcf5f-3364-44a8-b587-8c88b650ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:51.513629 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Volume 2b00299d-e343-498a-b3b0-aecb4d3ce031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b00299d-e343-498a-b3b0-aecb4d3ce031', 'volume_size': 1} Feb 12 21:28:51.514232 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] creating volume 'volume-2b00299d-e343-498a-b3b0-aecb4d3ce031' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:51.515560 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:51.967573 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-af8b28a9-547e-4f4a-859c-e7fe960f65ad tempest-GroupSnapshotsTest-1517788384 None] GroupSnapshot 46d8673a-41a7-48e4-b135-088cc81603cd: creating. Feb 12 21:28:51.988700 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-af8b28a9-547e-4f4a-859c-e7fe960f65ad tempest-GroupSnapshotsTest-1517788384 None] Group snapshot 46d8673a-41a7-48e4-b135-088cc81603cd: creating. {{(pid=134690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Feb 12 21:28:52.023679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-af8b28a9-547e-4f4a-859c-e7fe960f65ad tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:52.499279 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:52.500706 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:52.508983 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6dcf5f-3364-44a8-b587-8c88b650ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b00299d-e343-498a-b3b0-aecb4d3ce031', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:52.517756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4782a939-28a4-41d4-bfc1-2e0a0f88c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:52.625349 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Volume volume-2b00299d-e343-498a-b3b0-aecb4d3ce031 (2b00299d-e343-498a-b3b0-aecb4d3ce031): created successfully Feb 12 21:28:52.629347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4782a939-28a4-41d4-bfc1-2e0a0f88c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:52.634876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Flow 'volume_create_manager' (c6cb94f4-f953-454b-ae83-935918994df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:52.736388 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1f658ae4-ada1-42f7-8cee-0015e0059285 tempest-VolumesListAdminTestJSON-954407049 None] Created volume successfully. Feb 12 21:28:54.641108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:28:54.649469 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:28:54.655245 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:28:54.711069 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Flow 'volume_create_manager' (0dd783e3-97a3-4f9c-85ea-6a9fe0c5f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:54.719221 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce67e41f-9964-411d-9bd8-2654f8f6ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:54.733102 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:28:54.748000 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce67e41f-9964-411d-9bd8-2654f8f6ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c70c840fb64d9d9fa76d1e884b915c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:28:54Z,use_quota=True,user_id='1778967c58244c158fbc7c6712a7e80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:54.760287 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52bda45-7012-4fec-aa24-5933550bf978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:54.768145 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52bda45-7012-4fec-aa24-5933550bf978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:54.772656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c54a905-ea22-43ad-9c24-d710b68e2c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:54.777822 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c54a905-ea22-43ad-9c24-d710b68e2c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1', 'volume_name': 'volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:54.784764 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed0fe82-36c7-4386-987d-8e58fd202f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:54.789121 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed0fe82-36c7-4386-987d-8e58fd202f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:54.794303 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63710046-ff88-44fe-a96e-7201d53f4bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:54.796191 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Volume f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1', 'volume_size': 1} Feb 12 21:28:54.796763 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] creating volume 'volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:28:54.797864 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:56.102331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:28:56.102933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:28:56.108045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63710046-ff88-44fe-a96e-7201d53f4bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:56.119080 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc648e00-bf6d-4745-8af3-361c82220ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:28:56.196668 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Volume volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1 (f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1): created successfully Feb 12 21:28:56.201480 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc648e00-bf6d-4745-8af3-361c82220ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:28:56.208269 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Flow 'volume_create_manager' (0dd783e3-97a3-4f9c-85ea-6a9fe0c5f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:28:56.299688 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-04c9c5e4-9c00-4bd5-a0b4-7915a1461a49 tempest-VolumesListAdminTestJSON-1405586516 None] Created volume successfully. Feb 12 21:28:56.435505 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-af8b28a9-547e-4f4a-859c-e7fe960f65ad tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 46d8673a-41a7-48e4-b135-088cc81603cd: created successfully Feb 12 21:28:56.742300 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] Lock "b'cinder-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:56.862038 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:57.058775 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:57.063172 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] Volume volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:57.291611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] deleting rbd volume volume-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:57.307321 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] Lock "b'cinder-2b00299d-e343-498a-b3b0-aecb4d3ce031-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:28:57.425642 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:57.744166 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:28:57.746510 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] Volume volume-2b00299d-e343-498a-b3b0-aecb4d3ce031 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:28:58.045104 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] deleting rbd volume volume-2b00299d-e343-498a-b3b0-aecb4d3ce031 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:28:58.050670 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 46d8673a-41a7-48e4-b135-088cc81603cd: deleting Feb 12 21:28:58.077397 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 46d8673a-41a7-48e4-b135-088cc81603cd: deleting {{(pid=134690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Feb 12 21:28:58.112461 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:28:58.707620 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1203061f-bafb-4f5e-a9d1-93df0f63b0c6 tempest-GroupsTest-1076457626 None] Group tempest-Group1-1740723119: creating Feb 12 21:28:58.786619 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1203061f-bafb-4f5e-a9d1-93df0f63b0c6 tempest-GroupsTest-1076457626 None] Group tempest-Group1-1740723119: created successfully Feb 12 21:28:58.796870 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1203061f-bafb-4f5e-a9d1-93df0f63b0c6 tempest-GroupsTest-1076457626 None] Create group completed successfully. Feb 12 21:29:00.251094 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-674fbd86-416c-47d8-9f8d-0ce75d7514f8 tempest-GroupsTest-1076457626 None] Group tempest-Group2-826176251: creating Feb 12 21:29:00.369149 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-674fbd86-416c-47d8-9f8d-0ce75d7514f8 tempest-GroupsTest-1076457626 None] Group tempest-Group2-826176251: created successfully Feb 12 21:29:00.379282 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-674fbd86-416c-47d8-9f8d-0ce75d7514f8 tempest-GroupsTest-1076457626 None] Create group completed successfully. Feb 12 21:29:00.444660 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] Lock "b'cinder-26ca82ae-203e-4910-8cdd-d0a1425ce5d4-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:00.553325 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:03.701341 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] Volume volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:04.683077 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] deleting rbd volume volume-26ca82ae-203e-4910-8cdd-d0a1425ce5d4 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:04.876640 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-c8c0076a-137d-44c9-9b1d-feb70344ada7 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['8210f684-6bed-4aa5-8c0b-01dd60bf546c', 'b77d0223-5ffa-48f1-9a4f-a889c065dae8', '115acc39-972b-462a-ada0-77d943660143', '17dfaede-9133-4e8f-ac1c-7582665518ec'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:04.917908 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:04.921452 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:04.921839 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:04.941749 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Flow 'volume_create_manager' (27df8ca8-ea35-4fd9-8b1b-1f2d1ae861e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:04.949212 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81f2e43-f072-4d59-88dd-ea15c302a267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:04.955713 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:04.970626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81f2e43-f072-4d59-88dd-ea15c302a267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55441220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bcfb0cea-a2c4-4e7c-b355-cf4ee40d9c1a,host='ncdv-master-1@ceph#ceph',id=a0390ab7-b6dc-4017-b7ae-5eb4929704c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a96aaaa9f04d3bbff1b70d6181c4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:02Z,use_quota=True,user_id='0e50c578a59645cb943d3ca3f43a05e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c54b0e3f-b5a4-4b07-b3d6-0964c698b5f0),volume_type_id=c54b0e3f-b5a4-4b07-b3d6-0964c698b5f0)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:04.976214 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79333caa-0d3e-4961-921c-986fb3ede63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:04.980735 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79333caa-0d3e-4961-921c-986fb3ede63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:04.985966 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bb02ff-a47b-4cc3-86b7-b96a193446db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:04.990128 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bb02ff-a47b-4cc3-86b7-b96a193446db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0390ab7-b6dc-4017-b7ae-5eb4929704c8', 'volume_name': 'volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:04.995241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aea6ce-fc8a-47ec-8e18-49379cc52aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:04.999322 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aea6ce-fc8a-47ec-8e18-49379cc52aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:05.004234 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d10adb0-90a2-479f-b002-9bb341ecc1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:05.005385 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Volume a0390ab7-b6dc-4017-b7ae-5eb4929704c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8', 'volume_size': 1} Feb 12 21:29:05.008731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] creating volume 'volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:29:05.008731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:05.194642 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c8c0076a-137d-44c9-9b1d-feb70344ada7 tempest-TestVolumeBootPattern-1530501963 None] Delete snapshot completed successfully. Feb 12 21:29:05.203472 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c8c0076a-137d-44c9-9b1d-feb70344ada7 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-48da9167-46c3-4a44-91dc-095e52bb654a-delete_snapshot'" released by "delete_snapshot" :: held 36.323s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:05.856872 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1696366231 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1696366231, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:05.857804 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1696366231 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1696366231, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:05.861062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-0c9b3d32-9fd9-460b-9efc-4413eca4c43f tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['7f3553a5-4e99-4924-8560-ba5cf537d73f', 'c72a6499-3b9f-452a-ac65-da0f406e86b7', '8fa8cc36-6ecf-42eb-a2d1-493466612507', '60eee5a2-c0a4-420b-9ecb-4d707ad5d7d0'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:05.941743 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['ca288cb4-8f30-4a9d-b204-ae9e6394e802', '784279ae-8bef-46e2-a60b-7efc7dcd915d', 'b393572b-7c63-4cf9-ae2e-41dbb615a680', '61871e01-a668-46f3-8214-8e5659ffbb0c'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:06.087152 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0c9b3d32-9fd9-460b-9efc-4413eca4c43f tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:29:06.100183 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-0c9b3d32-9fd9-460b-9efc-4413eca4c43f tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-32d37d55-6f14-49f4-8f64-abd6ccdfebe4-delete_snapshot'" released by "delete_snapshot" :: held 32.945s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:06.312373 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:29:06.312767 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:29:06.316798 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d10adb0-90a2-479f-b002-9bb341ecc1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:06.322235 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5f7fdc-135c-4d52-be24-34e927fb93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:06.333994 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] Created reservations ['21f1af80-ef15-49e4-ac24-1a269126c1d6', 'e984e0e6-098f-4f03-9354-6588e2b97c33', 'b6b9ceec-6ac1-4806-a54c-1177ca5d5852', '5d766291-e043-4148-ba3c-b5646379ba24'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:06.356996 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6ab08261-1557-4ccd-bf64-f3432882f2de tempest-GroupSnapshotsTest-1517788384 None] group_snapshot 46d8673a-41a7-48e4-b135-088cc81603cd: deleted successfully Feb 12 21:29:06.360037 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] Created reservations ['2b1033e5-5eee-442c-920a-129da8fbe8e8', 'f68b2b6e-4be8-4689-94e1-b48fd6e59e7e', '49cb51a0-6b46-4249-99b9-df7c214abec2', 'e1008d50-315c-4aa4-995f-9c539e443fb0'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:06.444918 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Volume volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8 (a0390ab7-b6dc-4017-b7ae-5eb4929704c8): created successfully Feb 12 21:29:06.449252 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5f7fdc-135c-4d52-be24-34e927fb93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:06.455170 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Flow 'volume_create_manager' (27df8ca8-ea35-4fd9-8b1b-1f2d1ae861e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:06.579438 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-875fa4ac-b1e9-4138-824e-8ff8103b287c tempest-GroupsTest-1076457626 None] Created volume successfully. Feb 12 21:29:06.624917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:06.658331 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:06.686118 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:06.701223 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] Deleted volume successfully. Feb 12 21:29:06.717884 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-56904294-cf98-45dd-a4fb-5204004c66c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-45664641-ffcd-4fe8-a15e-ad3c5acc3dfb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:06.723091 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-56904294-cf98-45dd-a4fb-5204004c66c6 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:07.024788 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:07.060532 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:07.124242 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:07.134196 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] Deleted volume successfully. Feb 12 21:29:07.176184 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-79f825e4-4357-42c5-936b-a730e5fb49e5 tempest-VolumesListAdminTestJSON-1405586516 None] Lock "b'cinder-f36ae6a2-1272-4a1a-86f8-bbb2c1a111c1-delete_volume'" released by "delete_volume" :: held 10.434s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:07.179635 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] Lock "b'cinder-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d-delete_volume'" acquired by "delete_volume" :: waited 0.158s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:07.315427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1eae4901-1a16-491a-8002-ece18391573c tempest-VolumesListAdminTestJSON-954407049 None] Lock "b'cinder-2b00299d-e343-498a-b3b0-aecb4d3ce031-delete_volume'" released by "delete_volume" :: held 10.007s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:07.439702 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:07.819624 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:07.820361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] Volume volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:08.068224 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] deleting rbd volume volume-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:08.100301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:08.414255 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:08.414697 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] Volume volume-190a064f-1173-4723-a9f5-23d24dea9652 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:08.739306 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] deleting rbd volume volume-190a064f-1173-4723-a9f5-23d24dea9652 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:08.816375 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:09.036440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:09.037138 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Volume volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:09.225527 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] deleting rbd volume volume-a0390ab7-b6dc-4017-b7ae-5eb4929704c8 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:09.250734 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-d19ddeee-2b70-407c-8b70-fc6dbf59fd16 tempest-TestVolumeBootPattern-1530501963 None] Terminate volume connection completed successfully. Feb 12 21:29:09.252683 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-d19ddeee-2b70-407c-8b70-fc6dbf59fd16 tempest-TestVolumeBootPattern-1530501963 None] Deleting attachment 830c64a6-2a23-4a84-8e67-2586b4cf6e89. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:29:09.659781 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-ec995a3e-38b5-4860-a73f-89108774c4bf-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:09.850818 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:11.158368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:11.515108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] deleting rbd volume volume-ec995a3e-38b5-4860-a73f-89108774c4bf {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:11.517671 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:29:11.517671 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:11.578741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:11.637158 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:14.665248 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] Created reservations ['f84f7235-7fd2-44ed-a6f8-8800a945c5d4', 'e2f7beb7-1d74-4d56-8ce7-a8145ebca341', '9373a551-7939-4cf1-a029-abd5d5e4b8aa', 'fe202111-c8e9-42dd-975d-9662a3ba1658'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:14.853703 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:14.885147 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:14.928366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:14.935155 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] Deleted volume successfully. Feb 12 21:29:15.036997 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-525f437a-a3da-4daf-bbdb-56e38b76f678 tempest-VolumesBackupsV39Test-461572751 None] Lock "b'cinder-26ca82ae-203e-4910-8cdd-d0a1425ce5d4-delete_volume'" released by "delete_volume" :: held 14.591s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:16.983210 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] Created reservations ['89c1b46d-47a5-457e-87dc-99f79fadca45', '6209eea7-f131-440b-a1ad-31781175a4c1', 'fbae58a3-6e44-4fca-9662-ff4664e653ea', '678162ba-0ec8-4d9e-88a2-1514f0e60e12'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:17.185704 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:17.218705 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:17.243970 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:17.250819 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] Deleted volume successfully. Feb 12 21:29:17.327750 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-7c6fbce8-2ee1-4fb9-9866-6b67a3981bc4 tempest-VolumesListAdminTestJSON-954407049 None] Lock "b'cinder-7a1c7ef7-735c-4ba8-b954-8d6a57433a8d-delete_volume'" released by "delete_volume" :: held 10.148s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:17.870835 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] Lock "b'cinder-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:17.978433 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:18.292257 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:18.292257 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] Volume volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:18.596629 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] deleting rbd volume volume-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:18.989999 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['a7fa7497-199d-4f3e-9a3c-5fe06ef5c8e8'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:19.006884 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1696366231 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1696366231, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:19.070249 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Created reservations ['797a579a-50a6-4bc4-a640-4a2ee7de2759'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:19.127753 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] Created reservations ['7d24c0e6-02c5-4d94-bad6-d34f4ccedee6', 'f4336d66-2673-4ef7-b0c6-c4561fcf72f0', '84f18cb6-57b2-4e25-824e-154cbf04c443', '17626420-529c-4f14-9c8e-c3216af0e8f2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:19.143701 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1052837346 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1052837346, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:19.145176 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1052837346 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1052837346, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:19.265348 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Created reservations ['02a28f91-b8d6-48ec-83b1-c9af11b07872', 'fb6c7519-b974-4a3e-bbca-02eb48aaea8b', '90c00e82-4dff-4682-862d-9dd8bb659e5b', 'd992c325-c476-42f7-8409-1335e62c2d97'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:19.614527 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:19.674151 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:19.734369 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:19.740863 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ccd1eca0-1954-40c1-965b-2d45713f203a tempest-GroupSnapshotsTest-1517788384 None] Delete group completed successfully. Feb 12 21:29:19.748920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:19.780644 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:19.860677 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:19.868146 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-efa47436-7514-4758-af0b-83b03312bd89 tempest-GroupsTest-1076457626 None] Delete group completed successfully. Feb 12 21:29:20.255552 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:29:20.488361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] deleting parent snapshot volume-ec995a3e-38b5-4860-a73f-89108774c4bf.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:29:24.208341 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['496892b1-b1ed-4985-bde1-9d4ed6e77bba', 'a97b1757-8046-4348-b03e-09c44af724d6', '95cb1520-f4a3-4d14-a6eb-0fb13c704eac', 'bf955d21-9a6b-475a-b54f-40c3af4eeef1'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:24.385685 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f7cf41c8-d646-4a26-8b3e-58997a09de77 tempest-GroupsTest-1076457626 None] Created reservations ['4d45bc8f-ef30-4148-9819-52d46dad5d78'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:24.628679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7cf41c8-d646-4a26-8b3e-58997a09de77 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:24.706822 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7cf41c8-d646-4a26-8b3e-58997a09de77 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:24.787329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f7cf41c8-d646-4a26-8b3e-58997a09de77 tempest-GroupsTest-1076457626 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:24.796452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:24.881068 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:24.937987 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:24.956511 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f7cf41c8-d646-4a26-8b3e-58997a09de77 tempest-GroupsTest-1076457626 None] Delete group completed successfully. Feb 12 21:29:24.999606 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] Deleted volume successfully. Feb 12 21:29:25.142145 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] Created reservations ['36523a27-e0e7-4571-b39d-6cd2c9f653f6', 'c5d4e81b-12e5-4220-b0d3-74056d180fe2', '293a70f4-a4c4-4208-8bed-ff9cec6eaa11', '96996ad2-bcb5-4406-98c0-0c0ffc9febde'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:25.177616 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-aabd13f8-14d0-4412-ba21-c315ce33d01f req-3843e34c-e9b5-48dc-a0ef-f1a938c44db7 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-ec995a3e-38b5-4860-a73f-89108774c4bf-delete_volume'" released by "delete_volume" :: held 15.517s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:25.464944 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:25.544783 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:25.623138 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:25.627256 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] Deleted volume successfully. Feb 12 21:29:25.716270 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-4fcc88df-26fc-4998-8e2d-9bedf1ea32ca tempest-VolumesListAdminTestJSON-954407049 None] Lock "b'cinder-f8a8bf3f-b6bb-45ab-9e2b-702888d78c76-delete_volume'" released by "delete_volume" :: held 7.845s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:26.110946 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3eead20e-86cb-4158-8a6b-b42a5ac08bae tempest-GroupsTest-1076457626 None] Group tempest-GroupsTest-Group-1658280422: creating Feb 12 21:29:26.237055 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3eead20e-86cb-4158-8a6b-b42a5ac08bae tempest-GroupsTest-1076457626 None] Group tempest-GroupsTest-Group-1658280422: created successfully Feb 12 21:29:26.257725 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3eead20e-86cb-4158-8a6b-b42a5ac08bae tempest-GroupsTest-1076457626 None] Create group completed successfully. Feb 12 21:29:28.692046 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:28.708279 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:28.708733 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:28.769634 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Flow 'volume_create_manager' (97ca6a12-d43b-4613-9540-94c0c092ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:28.779812 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c4a578-5b6e-40f1-90ca-ac651c1c9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:28.787793 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:28.809650 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c4a578-5b6e-40f1-90ca-ac651c1c9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-509636084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0843ecee-98f3-4b76-825b-4b797c726b61,host='ncdv-master-1@ceph#ceph',id=35f365fb-b7e1-4b52-afe1-18ebfbe0180d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a96aaaa9f04d3bbff1b70d6181c4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:28Z,use_quota=True,user_id='0e50c578a59645cb943d3ca3f43a05e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c664f4f-d076-47b5-b1e2-69cf37ccf421),volume_type_id=4c664f4f-d076-47b5-b1e2-69cf37ccf421)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:28.817990 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b48e20-a55b-4144-901a-6919021930e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:28.825011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b48e20-a55b-4144-901a-6919021930e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:28.832433 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fc69f0-b6a6-4c64-9066-4e7f9fff386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:28.838736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fc69f0-b6a6-4c64-9066-4e7f9fff386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f365fb-b7e1-4b52-afe1-18ebfbe0180d', 'volume_name': 'volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:28.844693 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246649d0-080c-4b01-a37c-2907d0f1a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:28.852756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246649d0-080c-4b01-a37c-2907d0f1a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:28.862214 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1683607a-664b-47c3-ac5f-ed6c8e9139af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:28.864713 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Volume 35f365fb-b7e1-4b52-afe1-18ebfbe0180d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d', 'volume_size': 1} Feb 12 21:29:28.865655 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] creating volume 'volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:29:28.869889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:29.530499 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:29:29.531074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:29:29.535418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1683607a-664b-47c3-ac5f-ed6c8e9139af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:29.540737 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a108069-5bce-4b97-8a5e-fb2e2e2e980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:29.704947 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Volume volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d (35f365fb-b7e1-4b52-afe1-18ebfbe0180d): created successfully Feb 12 21:29:29.709297 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a108069-5bce-4b97-8a5e-fb2e2e2e980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:29.727190 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Flow 'volume_create_manager' (97ca6a12-d43b-4613-9540-94c0c092ae27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:29.835627 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-addafe65-bcf5-4b7f-86da-9a4a678a050e tempest-GroupsTest-1076457626 None] Created volume successfully. Feb 12 21:29:31.891766 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:31.895534 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:31.896249 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:31.927306 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Flow 'volume_create_manager' (aad6083e-ccf4-4df1-b2f7-1fa09c55c162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:31.934358 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12d2f86-afe1-46fd-9b1e-adb81ffd21e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:31.944506 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:31.968147 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12d2f86-afe1-46fd-9b1e-adb81ffd21e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-438988563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0843ecee-98f3-4b76-825b-4b797c726b61,host='ncdv-master-1@ceph#ceph',id=081354cb-d08b-48c6-b9a2-cc685d23c59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2a96aaaa9f04d3bbff1b70d6181c4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:32Z,use_quota=True,user_id='0e50c578a59645cb943d3ca3f43a05e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c664f4f-d076-47b5-b1e2-69cf37ccf421),volume_type_id=4c664f4f-d076-47b5-b1e2-69cf37ccf421)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:31.973969 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb70a13d-d834-411e-af60-fbabee2b3396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:31.978465 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb70a13d-d834-411e-af60-fbabee2b3396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:31.984656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140c5c5a-240b-48c4-9ba5-6fcde626d0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:31.988956 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140c5c5a-240b-48c4-9ba5-6fcde626d0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081354cb-d08b-48c6-b9a2-cc685d23c59a', 'volume_name': 'volume-081354cb-d08b-48c6-b9a2-cc685d23c59a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:31.994832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8bf8ce-d867-4ff0-9056-51293b87e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:31.999039 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8bf8ce-d867-4ff0-9056-51293b87e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:32.003954 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a3bd28-1a7e-4fa0-8757-a27de3162ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:32.005107 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Volume 081354cb-d08b-48c6-b9a2-cc685d23c59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081354cb-d08b-48c6-b9a2-cc685d23c59a', 'volume_size': 1} Feb 12 21:29:32.005564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] creating volume 'volume-081354cb-d08b-48c6-b9a2-cc685d23c59a' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:29:32.006534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:32.576276 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:29:32.576656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:29:32.580896 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a3bd28-1a7e-4fa0-8757-a27de3162ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081354cb-d08b-48c6-b9a2-cc685d23c59a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:32.591924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ea8d25-02a8-40bf-b6f4-8ba566b19eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:32.720216 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Volume volume-081354cb-d08b-48c6-b9a2-cc685d23c59a (081354cb-d08b-48c6-b9a2-cc685d23c59a): created successfully Feb 12 21:29:32.725152 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ea8d25-02a8-40bf-b6f4-8ba566b19eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:32.733826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Flow 'volume_create_manager' (aad6083e-ccf4-4df1-b2f7-1fa09c55c162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:32.824258 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1c63734e-dd41-4ee8-944d-f56f009f20b3 tempest-GroupsTest-1076457626 None] Created volume successfully. Feb 12 21:29:34.187898 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b7a6fa57-2b2b-4eba-a47a-18e9f2f7ba07 tempest-GroupsTest-1076457626 None] Update group completed successfully. Feb 12 21:29:35.594829 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:35.603370 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:35.604579 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:35.628456 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (9cf666e6-8388-4824-b0f6-be2561b83b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:35.636286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8402f2f-512a-409c-91da-6946b1bb5b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:35.653419 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-d7117f0a-955f-4400-a670-0168e81eb2ed tempest-GroupsTest-1076457626 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:35.690450 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8402f2f-512a-409c-91da-6946b1bb5b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-714564704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=246c1cd8-ec05-45ad-9455-c09c770c0c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c11b938ee814f3180aa6e0f37c4e1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:35Z,use_quota=True,user_id='cc56a9a0488e44d7935295ed39bfbb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:35.708965 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6521aa-ef1d-46d1-adda-1d7c06c98eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:35.715124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6521aa-ef1d-46d1-adda-1d7c06c98eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:35.721110 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99984839-ae8a-48da-9499-5ed1c4428ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:35.842891 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99984839-ae8a-48da-9499-5ed1c4428ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '246c1cd8-ec05-45ad-9455-c09c770c0c58', 'volume_name': 'volume-246c1cd8-ec05-45ad-9455-c09c770c0c58', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:35.849286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826de8dd-8147-46bf-8455-fb1efb54f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:35.854773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826de8dd-8147-46bf-8455-fb1efb54f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:35.860369 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1e759b-08e2-4d94-b833-3148ed0f52ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:35.861949 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Volume 246c1cd8-ec05-45ad-9455-c09c770c0c58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-246c1cd8-ec05-45ad-9455-c09c770c0c58', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:29:35.862890 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Cloning 246c1cd8-ec05-45ad-9455-c09c770c0c58 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:29:35.897520 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d7117f0a-955f-4400-a670-0168e81eb2ed tempest-GroupsTest-1076457626 None] Update group completed successfully. Feb 12 21:29:35.899531 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.036s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:35.981614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 29, 35, 904301)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:29:35.982608 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:29:35.983377 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:29:35.990192 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.091s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:35.993336 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:29:36.001219 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 29, 35, 998087)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:29:36.002055 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:29:36.002772 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:29:36.022547 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:36.204033 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] creating snapshot='volume-246c1cd8-ec05-45ad-9455-c09c770c0c58.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:29:38.599782 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-246c1cd8-ec05-45ad-9455-c09c770c0c58.clone_snap' to 'volume-246c1cd8-ec05-45ad-9455-c09c770c0c58' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:29:38.704952 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:39.055540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:39.056072 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Volume volume-081354cb-d08b-48c6-b9a2-cc685d23c59a is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:39.411160 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] deleting rbd volume volume-081354cb-d08b-48c6-b9a2-cc685d23c59a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:39.870772 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-56904294-cf98-45dd-a4fb-5204004c66c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['5c186391-ba04-4f8d-971f-30799029ac40', 'e9cba78d-3e05-4390-aff9-ea5c95ab60de', '0bc4815c-71e0-4057-8380-228ab3982928', '48a263f1-14ea-456c-913b-c9e4dd8bbb35'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:40.121660 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-56904294-cf98-45dd-a4fb-5204004c66c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:29:40.127710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-56904294-cf98-45dd-a4fb-5204004c66c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-45664641-ffcd-4fe8-a15e-ad3c5acc3dfb-delete_snapshot'" released by "delete_snapshot" :: held 33.410s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:29:40.737614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:40.739479 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:29:40.740010 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:29:41.730625 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:29:41.732925 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Marking volume 246c1cd8-ec05-45ad-9455-c09c770c0c58 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:29:41.816301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 246c1cd8-ec05-45ad-9455-c09c770c0c58. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:29:41.816722 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Creating volume glance metadata for volume 246c1cd8-ec05-45ad-9455-c09c770c0c58 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:29:42.029627 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1e759b-08e2-4d94-b833-3148ed0f52ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246c1cd8-ec05-45ad-9455-c09c770c0c58', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:42.043113 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d280600-859b-473c-a845-40c0e3d45a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:42.155333 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Volume volume-246c1cd8-ec05-45ad-9455-c09c770c0c58 (246c1cd8-ec05-45ad-9455-c09c770c0c58): created successfully Feb 12 21:29:42.155333 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d280600-859b-473c-a845-40c0e3d45a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:42.155333 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Flow 'volume_create_manager' (9cf666e6-8388-4824-b0f6-be2561b83b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:42.267340 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-719a7f6c-bf00-4aa1-b7db-fc86f3406207 tempest-TestVolumeBootPattern-1530501963 None] Created volume successfully. Feb 12 21:29:42.512292 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-fa6f433e-2e58-4aef-acda-cd676bd8a824 req-15f615d2-cc82-4a1e-b5e4-665476ec7bae tempest-VolumesSnapshotTestJSON-1959179807 None] Terminate volume connection completed successfully. Feb 12 21:29:42.512707 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-fa6f433e-2e58-4aef-acda-cd676bd8a824 req-15f615d2-cc82-4a1e-b5e4-665476ec7bae tempest-VolumesSnapshotTestJSON-1959179807 None] Deleting attachment 90677f1d-70d0-477c-a142-a02d459c2e04. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:29:44.913920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:45.148708 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:29:45.149735 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Volume volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:29:45.342087 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] deleting rbd volume volume-35f365fb-b7e1-4b52-afe1-18ebfbe0180d {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:29:45.634809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:45.639088 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:45.639537 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:45.680418 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Flow 'volume_create_manager' (70965d53-3bb0-4441-981e-1c2c03b8eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:45.691330 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a61886-3a6d-4a12-b73e-beb678203471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:45.718827 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:45.764957 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a61886-3a6d-4a12-b73e-beb678203471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-820770151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d694ca6-2d76-4bee-bb8d-6563636d1cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d868d91217e64b8681cfbc345fc470ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:45Z,use_quota=True,user_id='7c36c6c61182472dac1c3e29a5293507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:45.777810 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecc13b6-3ef9-4541-8c3a-07e8c5cacbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:45.790871 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecc13b6-3ef9-4541-8c3a-07e8c5cacbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:45.805672 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956effa9-e170-4d87-acf8-1d317a8b3b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:45.815497 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956effa9-e170-4d87-acf8-1d317a8b3b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d694ca6-2d76-4bee-bb8d-6563636d1cc1', 'volume_name': 'volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:45.827204 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf515b77-d6b8-453a-a7d4-0bdd50c8591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:45.843667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf515b77-d6b8-453a-a7d4-0bdd50c8591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:45.849252 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a9adf2-405b-4d8d-8c49-3e34b93eee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:45.853086 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Volume 8d694ca6-2d76-4bee-bb8d-6563636d1cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1', 'volume_size': 1} Feb 12 21:29:45.855076 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] creating volume 'volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:29:45.860142 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:46.925215 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:29:46.925930 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:29:46.929984 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a9adf2-405b-4d8d-8c49-3e34b93eee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:46.935990 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65346e1f-ec2d-4ae6-aaf4-99683a46be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:47.022461 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Volume volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1 (8d694ca6-2d76-4bee-bb8d-6563636d1cc1): created successfully Feb 12 21:29:47.028945 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65346e1f-ec2d-4ae6-aaf4-99683a46be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:47.045496 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Flow 'volume_create_manager' (70965d53-3bb0-4441-981e-1c2c03b8eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:47.153278 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9b4005ef-671b-40f6-a316-b703878bdb9f tempest-SnapshotMetadataTestJSON-1597155546 None] Created volume successfully. Feb 12 21:29:48.371857 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2071a16f-9fc8-459d-b9a2-f883a9e26e91 tempest-SnapshotMetadataTestJSON-1597155546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:50.828166 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef req-7f816f74-d9e5-489d-ade9-b4dc1733716e tempest-TestVolumeBootPattern-1530501963 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:29:51.161349 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Created reservations ['8a370d84-5fa4-46ab-9608-481f9beb0f46'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:51.230413 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2132043991 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2132043991, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:51.231418 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2132043991 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2132043991, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:29:51.257656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:51.268318 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:51.269853 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:51.330099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (1fb910a3-66d6-4883-a93b-95f15fb2493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:51.339495 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8ec18c-4107-437b-9c5f-0545a8c2d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:51.349345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Created reservations ['a402c1b0-882e-4a0f-bb1a-55196e7680d8', '5777a0d1-347a-4953-92a4-dcbd2b34551a', 'e9c8d890-bae9-45db-8a80-93d806b60ff5', '4d043fcf-1e39-4b61-afb9-f9a44d52ee88'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:51.357251 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:51.382382 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8ec18c-4107-437b-9c5f-0545a8c2d213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-552714387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95c3c394-fe73-43bc-a253-8e954d2730bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07de9e87ea3f495f90baaf85d83b982c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:51Z,use_quota=True,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:51.390900 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffec5260-6c5e-4532-b4bb-3c48b41363ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:51.406637 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffec5260-6c5e-4532-b4bb-3c48b41363ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:51.413959 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28640d8c-d277-4868-b9c8-5983c9d8f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:51.422011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28640d8c-d277-4868-b9c8-5983c9d8f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c3c394-fe73-43bc-a253-8e954d2730bb', 'volume_name': 'volume-95c3c394-fe73-43bc-a253-8e954d2730bb', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:51.428638 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dfe880-de24-4cdc-853e-2df40c28bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:51.434060 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dfe880-de24-4cdc-853e-2df40c28bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:51.441093 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c67282d-a482-43c8-8547-a62430a113f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:51.442512 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Volume 95c3c394-fe73-43bc-a253-8e954d2730bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c3c394-fe73-43bc-a253-8e954d2730bb', 'volume_size': 1} Feb 12 21:29:51.443114 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] creating volume 'volume-95c3c394-fe73-43bc-a253-8e954d2730bb' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:29:51.444460 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:51.686403 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2071a16f-9fc8-459d-b9a2-f883a9e26e91 tempest-SnapshotMetadataTestJSON-1597155546 None] Create snapshot completed successfully Feb 12 21:29:51.969503 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Created reservations ['ff67648d-3c29-4d87-bc1a-876a0ab77ff8', 'aa4d25b4-cb07-4e5e-bb23-69ea98aa5e00', 'cd53aaad-8444-4f59-a150-c90720e27db0', '70be7e7e-d20a-44c8-8fde-fa0b0c3774f6'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:29:52.138175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:29:52.139412 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:29:52.144430 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c67282d-a482-43c8-8547-a62430a113f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c3c394-fe73-43bc-a253-8e954d2730bb', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:52.168521 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2dc7a6-0549-4074-8320-5bc9cb86afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:52.290460 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-95c3c394-fe73-43bc-a253-8e954d2730bb (95c3c394-fe73-43bc-a253-8e954d2730bb): created successfully Feb 12 21:29:52.294514 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2dc7a6-0549-4074-8320-5bc9cb86afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:52.304305 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (1fb910a3-66d6-4883-a93b-95f15fb2493b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:52.328915 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef req-7f816f74-d9e5-489d-ade9-b4dc1733716e tempest-TestVolumeBootPattern-1530501963 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.500s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:29:52.331162 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef req-7f816f74-d9e5-489d-ade9-b4dc1733716e tempest-TestVolumeBootPattern-1530501963 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-246c1cd8-ec05-45ad-9455-c09c770c0c58', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '246c1cd8-ec05-45ad-9455-c09c770c0c58', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:29:52.388060 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-14748c3a-8957-4918-a46c-1ecfddd7dfae tempest-VolumesSnapshotTestJSON-1959179807 None] Created volume successfully. Feb 12 21:29:52.510127 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef req-7f816f74-d9e5-489d-ade9-b4dc1733716e tempest-TestVolumeBootPattern-1530501963 None] Connection info returned from driver {'name': 'volumes/volume-246c1cd8-ec05-45ad-9455-c09c770c0c58', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '246c1cd8-ec05-45ad-9455-c09c770c0c58', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '45768f45-8afb-4bda-84d3-91a503040a0a'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:29:52.639241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:52.707663 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:52.797047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:29:52.797047 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a28c0ddb-6a98-4596-b4f0-9ad5952be1d1 tempest-GroupsTest-1076457626 None] Delete group completed successfully. Feb 12 21:29:52.836095 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef req-7f816f74-d9e5-489d-ade9-b4dc1733716e tempest-TestVolumeBootPattern-1530501963 None] attachment_update completed successfully. Feb 12 21:29:53.795932 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-22ae76e0-a498-4934-b86f-78d2d3b39377 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:55.304825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-329b4cad-7830-4576-8413-b92212d7a9b9 tempest-SnapshotMetadataTestJSON-1597155546 None] Lock "b'cinder-58979066-4a76-4683-9128-6116402e5310-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:29:55.308022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-329b4cad-7830-4576-8413-b92212d7a9b9 tempest-SnapshotMetadataTestJSON-1597155546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:57.061946 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-22ae76e0-a498-4934-b86f-78d2d3b39377 tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:29:59.398540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:29:59.408806 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:29:59.409589 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:29:59.453999 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (f5635924-a642-4a60-8aa8-4abd33c2bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:29:59.461248 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fd9a6d-268e-4cb6-b6d7-4abc3ebb3003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:59.492194 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:29:59.532766 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fd9a6d-268e-4cb6-b6d7-4abc3ebb3003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-12920678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6b97940-2425-42b0-a0be-806c7b5d1af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07de9e87ea3f495f90baaf85d83b982c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:29:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=081b5ebb-4940-4280-adf7-2fd194f5aa6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:29:59Z,use_quota=True,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:59.548409 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b34295-c17c-42c3-a7ae-3c3bf4944396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:59.558320 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b34295-c17c-42c3-a7ae-3c3bf4944396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:59.568988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b889f-72c3-4b09-8d22-db96abf3a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:59.580491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081b889f-72c3-4b09-8d22-db96abf3a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6b97940-2425-42b0-a0be-806c7b5d1af2', 'volume_name': 'volume-e6b97940-2425-42b0-a0be-806c7b5d1af2', 'volume_size': 2, 'snapshot_id': '081b5ebb-4940-4280-adf7-2fd194f5aa6f'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:59.598763 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1930658-d100-4ba1-9383-e1770f235ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:59.607622 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1930658-d100-4ba1-9383-e1770f235ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:29:59.621005 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0798de9-73ea-40bf-abd4-ce54f11f3a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:29:59.625662 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Volume e6b97940-2425-42b0-a0be-806c7b5d1af2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6b97940-2425-42b0-a0be-806c7b5d1af2', 'volume_size': 2, 'snapshot_id': '081b5ebb-4940-4280-adf7-2fd194f5aa6f'} Feb 12 21:29:59.687780 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] cloning volumes/volume-95c3c394-fe73-43bc-a253-8e954d2730bb@snapshot-081b5ebb-4940-4280-adf7-2fd194f5aa6f to volume-e6b97940-2425-42b0-a0be-806c7b5d1af2 {{(pid=134690) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 12 21:29:59.689086 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:59.755769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:29:59.979236 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-329b4cad-7830-4576-8413-b92212d7a9b9 tempest-SnapshotMetadataTestJSON-1597155546 None] Created reservations ['5023b955-afdf-48c7-bb9f-99823c3f288a', '59782c11-7f12-4c3e-9377-ef4fab0191c7', 'e0afebf8-2dff-4c4e-9e99-0bca8045c6e0', 'd36f68e7-68b8-463d-8a94-cc2b66fa4f66'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:00.269523 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-329b4cad-7830-4576-8413-b92212d7a9b9 tempest-SnapshotMetadataTestJSON-1597155546 None] Delete snapshot completed successfully. Feb 12 21:30:00.278556 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-329b4cad-7830-4576-8413-b92212d7a9b9 tempest-SnapshotMetadataTestJSON-1597155546 None] Lock "b'cinder-58979066-4a76-4683-9128-6116402e5310-delete_snapshot'" released by "delete_snapshot" :: held 4.973s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:00.811773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] Lock "b'cinder-8d694ca6-2d76-4bee-bb8d-6563636d1cc1-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:00.911061 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:01.104219 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:01.104934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] Volume volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:30:01.384166 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] deleting rbd volume volume-8d694ca6-2d76-4bee-bb8d-6563636d1cc1 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:01.615861 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:01.616257 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:01.621820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:04.019995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0798de9-73ea-40bf-abd4-ce54f11f3a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b97940-2425-42b0-a0be-806c7b5d1af2', 'volume_size': 2, 'snapshot_id': '081b5ebb-4940-4280-adf7-2fd194f5aa6f'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:04.027341 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e5957c-ff94-4304-ae7e-084490e605fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:04.096860 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-e6b97940-2425-42b0-a0be-806c7b5d1af2 (e6b97940-2425-42b0-a0be-806c7b5d1af2): created successfully Feb 12 21:30:04.101934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e5957c-ff94-4304-ae7e-084490e605fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:04.110974 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (f5635924-a642-4a60-8aa8-4abd33c2bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:04.228494 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-4bbac9aa-bea4-49da-8150-0412f5d8e8ee tempest-VolumesSnapshotTestJSON-1959179807 None] Created volume successfully. Feb 12 21:30:04.645411 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-e6b97940-2425-42b0-a0be-806c7b5d1af2-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:04.800759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:05.015764 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:05.269863 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-e6b97940-2425-42b0-a0be-806c7b5d1af2 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:08.325030 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] Created reservations ['ec978d77-d4fa-4932-a737-5f11101ba9f4', 'dee0d8a4-d01d-4199-8d6c-ca02f697325f', '9d9eb99a-d28b-4cb4-96e5-eeaae353a2bc', 'e70eda43-2cde-4604-aa66-a7ac92dc855f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:08.608637 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:08.672385 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:08.711760 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:08.724441 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] Deleted volume successfully. Feb 12 21:30:08.815128 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-13f144c0-ced9-4fbf-a677-3b7f0f70c092 tempest-SnapshotMetadataTestJSON-1597155546 None] Lock "b'cinder-8d694ca6-2d76-4bee-bb8d-6563636d1cc1-delete_volume'" released by "delete_volume" :: held 8.006s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:11.263995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['a67b5d84-3c41-4fae-ad18-821ad966ffa1', '7d5d2fa6-ea46-4d71-8849-ec5b9a852407', '3223c736-4e39-4da3-88fe-f5e48a31ecd1', 'f42ee98c-4573-492c-9019-5697de9858d0'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:11.519980 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:30:11.520983 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:11.582585 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:11.679683 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:11.708407 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:11.784074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:11.847483 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:11.862803 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:30:11.972656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e1318cc2-f57c-4724-ae0f-19cd63d50f31 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-e6b97940-2425-42b0-a0be-806c7b5d1af2-delete_volume'" released by "delete_volume" :: held 7.327s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:13.767419 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:30:13.771147 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:30:13.771925 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:30:13.820095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (84b974ca-4958-4056-8012-0b77e4e0ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:13.834325 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75a460d-c55f-4cf5-8d25-0b7bb199ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:13.846682 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:30:13.871076 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75a460d-c55f-4cf5-8d25-0b7bb199ca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-43220536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fff64e69-0d36-4dd8-a25f-e61cbd8c8598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07de9e87ea3f495f90baaf85d83b982c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:30:14Z,use_quota=True,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:13.878412 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06b1760-b3db-4dfa-8dcb-420f90f9f40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:13.883325 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06b1760-b3db-4dfa-8dcb-420f90f9f40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:13.889951 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235586a3-f6f4-4f04-8dc9-8b55890225b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:13.894732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235586a3-f6f4-4f04-8dc9-8b55890225b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff64e69-0d36-4dd8-a25f-e61cbd8c8598', 'volume_name': 'volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:13.900804 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61db67dd-2e5c-4ba4-bec5-efba2c22cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:13.905640 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61db67dd-2e5c-4ba4-bec5-efba2c22cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:13.911797 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2701f7a-a6ca-4314-bf4c-b0076aef53fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:13.913334 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume fff64e69-0d36-4dd8-a25f-e61cbd8c8598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598', 'volume_size': 1} Feb 12 21:30:13.914182 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] creating volume 'volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:30:13.916010 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:14.653646 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:14.653646 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:14.660961 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2701f7a-a6ca-4314-bf4c-b0076aef53fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:14.670153 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12100fc3-aea3-4664-adf1-468cf7b3177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:14.821753 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598 (fff64e69-0d36-4dd8-a25f-e61cbd8c8598): created successfully Feb 12 21:30:14.826669 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12100fc3-aea3-4664-adf1-468cf7b3177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:14.835307 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (84b974ca-4958-4056-8012-0b77e4e0ba49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:14.926784 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-98da241e-5a02-4ae4-9a34-949dbf681119 tempest-VolumesSnapshotTestJSON-1959179807 None] Created volume successfully. Feb 12 21:30:15.619705 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:30:15.623854 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:30:15.624512 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:30:15.653053 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Flow 'volume_create_manager' (45684a73-11da-4918-92ea-0fb3aae444c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:15.662999 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efe2a6c-6a9b-4ff6-ac64-90e1f5c33695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:15.673120 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:30:15.707629 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efe2a6c-6a9b-4ff6-ac64-90e1f5c33695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1397242833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f53982ef-7ff7-43b0-9c4f-5523ac072661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a598cc4c02447e92bc5932994a93fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:30:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:30:15Z,use_quota=True,user_id='20f3d1da3f254bccab8c6a8ad6d68733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:15.730799 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172a78cd-8a5e-4c2e-b1d9-e0efb3c02b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:15.734483 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172a78cd-8a5e-4c2e-b1d9-e0efb3c02b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:15.748919 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3015e53e-2e34-4d32-aca2-4aee30e77bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:15.753290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3015e53e-2e34-4d32-aca2-4aee30e77bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53982ef-7ff7-43b0-9c4f-5523ac072661', 'volume_name': 'volume-f53982ef-7ff7-43b0-9c4f-5523ac072661', 'volume_size': 2}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:15.770561 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7232d4b4-6e82-470d-81c0-e9dc156976db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:15.776731 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7232d4b4-6e82-470d-81c0-e9dc156976db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:15.781904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f59569-d45e-4ac9-938e-93b2df60a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:15.786105 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Volume f53982ef-7ff7-43b0-9c4f-5523ac072661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53982ef-7ff7-43b0-9c4f-5523ac072661', 'volume_size': 2} Feb 12 21:30:15.786105 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] creating volume 'volume-f53982ef-7ff7-43b0-9c4f-5523ac072661' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:30:15.786105 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:16.286017 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-965972e2-d6c9-4eb5-94ae-e8b565e5ba9f tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:16.542200 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:16.542583 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:16.547779 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f59569-d45e-4ac9-938e-93b2df60a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53982ef-7ff7-43b0-9c4f-5523ac072661', 'volume_size': 2}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:16.572794 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bf1aa7-c164-4145-a93e-ecdc01274dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:16.658545 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Volume volume-f53982ef-7ff7-43b0-9c4f-5523ac072661 (f53982ef-7ff7-43b0-9c4f-5523ac072661): created successfully Feb 12 21:30:16.666920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bf1aa7-c164-4145-a93e-ecdc01274dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:16.669142 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Flow 'volume_create_manager' (45684a73-11da-4918-92ea-0fb3aae444c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:16.865044 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-477ebd4c-3af7-4cfe-9b88-58393c6dae6b tempest-VolumesCloneNegativeTest-1912134328 None] Created volume successfully. Feb 12 21:30:17.809792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] Lock "b'cinder-f53982ef-7ff7-43b0-9c4f-5523ac072661-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:17.941272 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:18.307612 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:18.311605 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] Volume volume-f53982ef-7ff7-43b0-9c4f-5523ac072661 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:30:18.688253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] deleting rbd volume volume-f53982ef-7ff7-43b0-9c4f-5523ac072661 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:20.308851 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-965972e2-d6c9-4eb5-94ae-e8b565e5ba9f tempest-VolumesSnapshotTestJSON-1959179807 None] Create snapshot completed successfully Feb 12 21:30:22.467555 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:30:22.480120 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:30:22.482299 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:30:22.543774 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (fa5e7240-b59c-455a-9239-ad0725343e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:22.562265 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e85090-5195-4316-b0c9-22de8b83861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:22.589165 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:30:22.624546 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e85090-5195-4316-b0c9-22de8b83861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-866784727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecba4a95-5ee1-4748-aef8-27c56f9bbae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07de9e87ea3f495f90baaf85d83b982c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbf986bc-b3be-4620-83fb-02e5e925ea8e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:30:22Z,use_quota=True,user_id='7190c407ef794576a92dc5616e2ec4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:22.634694 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bfba2e-2c57-46b4-9f3d-40566151e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:22.639976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bfba2e-2c57-46b4-9f3d-40566151e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:22.651792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701c1b19-0e9d-460f-a14b-2d89fa689da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:22.658560 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701c1b19-0e9d-460f-a14b-2d89fa689da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecba4a95-5ee1-4748-aef8-27c56f9bbae1', 'volume_name': 'volume-ecba4a95-5ee1-4748-aef8-27c56f9bbae1', 'volume_size': 1, 'snapshot_id': 'dbf986bc-b3be-4620-83fb-02e5e925ea8e'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:22.667252 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddeb72a-9583-4012-9031-acdea8f2e3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:22.673342 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddeb72a-9583-4012-9031-acdea8f2e3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:22.680619 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eba39c4-c5e7-4f24-8ca0-8132dd81f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:22.682387 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume ecba4a95-5ee1-4748-aef8-27c56f9bbae1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecba4a95-5ee1-4748-aef8-27c56f9bbae1', 'volume_size': 1, 'snapshot_id': 'dbf986bc-b3be-4620-83fb-02e5e925ea8e'} Feb 12 21:30:22.710511 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] cloning volumes/volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598@snapshot-dbf986bc-b3be-4620-83fb-02e5e925ea8e to volume-ecba4a95-5ee1-4748-aef8-27c56f9bbae1 {{(pid=134690) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Feb 12 21:30:22.711705 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:22.800292 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:24.829345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] Created reservations ['772a4a18-7fb6-456d-8a56-a9900a0dfecb', 'ac4a9ce7-ba03-4905-9856-5a34612c2589', 'dd40ac13-e27e-4263-aed8-f2e29b36b66b', '0a51b7d3-ff1b-4862-9ee4-f61602db007d'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:25.138254 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:25.195820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:25.276229 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:25.281726 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] Deleted volume successfully. Feb 12 21:30:25.297534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:25.298034 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:25.339857 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eba39c4-c5e7-4f24-8ca0-8132dd81f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecba4a95-5ee1-4748-aef8-27c56f9bbae1', 'volume_size': 1, 'snapshot_id': 'dbf986bc-b3be-4620-83fb-02e5e925ea8e'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:25.345691 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df23d7c9-e990-49ed-93ed-9f05b4592817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:25.361789 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-3d90792b-9a90-4b9e-a04f-134be4befac3 tempest-VolumesCloneNegativeTest-1912134328 None] Lock "b'cinder-f53982ef-7ff7-43b0-9c4f-5523ac072661-delete_volume'" released by "delete_volume" :: held 7.552s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:25.436203 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-ecba4a95-5ee1-4748-aef8-27c56f9bbae1 (ecba4a95-5ee1-4748-aef8-27c56f9bbae1): created successfully Feb 12 21:30:25.441183 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df23d7c9-e990-49ed-93ed-9f05b4592817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:25.449101 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Flow 'volume_create_manager' (fa5e7240-b59c-455a-9239-ad0725343e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:25.554616 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-27225c2a-a841-4793-8b28-9492eabb0636 tempest-VolumesSnapshotTestJSON-1959179807 None] Created volume successfully. Feb 12 21:30:26.942686 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-ecba4a95-5ee1-4748-aef8-27c56f9bbae1-delete_volume'" acquired by "delete_volume" :: waited 0.048s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:27.082832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:27.314329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:27.481904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-ecba4a95-5ee1-4748-aef8-27c56f9bbae1 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:31.632611 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:30:31.647757 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:30:31.647757 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:30:31.688284 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Flow 'volume_create_manager' (877b3ece-d0b5-486e-8e3e-70714f0a47b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:31.706781 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889dfbec-597a-4975-bc8c-0fedffc35aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:31.740375 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:30:31.781327 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889dfbec-597a-4975-bc8c-0fedffc35aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1065050988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d099d6f-2ad2-42c9-afe0-4edb1118f461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb7edbcd0864f13be6f5138d1350e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:30:31Z,use_quota=True,user_id='d083b81672cd463fb6cce6f8a602bb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:31.798842 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ab11a0-fbaa-4d3f-840e-fc2f774e118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:31.811536 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ab11a0-fbaa-4d3f-840e-fc2f774e118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:31.830160 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df8d864-a7a5-41e9-b252-2b3a33e9eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:31.834705 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df8d864-a7a5-41e9-b252-2b3a33e9eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'volume_name': 'volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:31.841011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4e8082-891d-4cfb-91cc-7a30f2bcf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:31.845634 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4e8082-891d-4cfb-91cc-7a30f2bcf454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:31.851054 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce77cb3f-6258-4961-bd92-17721fc63d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:31.853313 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Volume 3d099d6f-2ad2-42c9-afe0-4edb1118f461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'volume_size': 1} Feb 12 21:30:31.853912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] creating volume 'volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:30:31.855115 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:31.999704 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:30:32.004146 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:30:32.005311 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:30:32.046384 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (e1fc99f0-6d56-44d6-af1b-f99aefb29e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:32.059575 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead4a77f-7073-41fd-84d1-677eafd7980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:32.068977 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:30:32.093461 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead4a77f-7073-41fd-84d1-677eafd7980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2080878650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db2bc108-c046-4572-9fa3-d1d721e57d95,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:30:32Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:32.096105 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014037a2-0097-41c3-bc48-c05f33a318ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:32.105415 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014037a2-0097-41c3-bc48-c05f33a318ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:32.114983 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0242ad14-6440-4880-8529-57214e711154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:32.123756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0242ad14-6440-4880-8529-57214e711154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2bc108-c046-4572-9fa3-d1d721e57d95', 'volume_name': 'volume-db2bc108-c046-4572-9fa3-d1d721e57d95', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:32.135431 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bcd92-9647-4fc1-b991-531ca3ca31cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:32.145975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530bcd92-9647-4fc1-b991-531ca3ca31cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:32.159286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed474121-611f-49d0-9c40-3b34c2eea6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:32.159286 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Volume db2bc108-c046-4572-9fa3-d1d721e57d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2bc108-c046-4572-9fa3-d1d721e57d95', 'volume_size': 1} Feb 12 21:30:32.159286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] creating volume 'volume-db2bc108-c046-4572-9fa3-d1d721e57d95' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:30:32.159286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:33.093869 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:33.096292 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:33.103424 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce77cb3f-6258-4961-bd92-17721fc63d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:33.115405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3413a36-095b-493e-bca5-ce9d136987d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:33.202136 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Volume volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461 (3d099d6f-2ad2-42c9-afe0-4edb1118f461): created successfully Feb 12 21:30:33.211849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3413a36-095b-493e-bca5-ce9d136987d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:33.229302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Flow 'volume_create_manager' (877b3ece-d0b5-486e-8e3e-70714f0a47b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:33.337199 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:33.337610 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:33.341830 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed474121-611f-49d0-9c40-3b34c2eea6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2bc108-c046-4572-9fa3-d1d721e57d95', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:33.354328 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95140a0a-01a2-4f7a-8eef-eede722fab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:33.366973 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-157bce1f-1da2-492c-a307-29c3131dedd5 tempest-VolumesBackupsTest-835000994 None] Created volume successfully. Feb 12 21:30:33.505935 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Volume volume-db2bc108-c046-4572-9fa3-d1d721e57d95 (db2bc108-c046-4572-9fa3-d1d721e57d95): created successfully Feb 12 21:30:33.512096 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95140a0a-01a2-4f7a-8eef-eede722fab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:33.516897 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (e1fc99f0-6d56-44d6-af1b-f99aefb29e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:33.651560 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-daf82ad9-ca9f-467d-959e-7823fa8ebd39 tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:30:35.433102 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['9e9cd330-f764-44ec-9714-11419ca49134', '2ae446a3-cab8-40a2-b308-90b73b8eabc6', '7515c33a-393c-4768-83f7-cd265ee527de', 'ae324ad9-6f64-40b3-8e36-ddb3707b6569'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:35.795026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:35.939161 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:36.013339 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:36.020809 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:30:36.134180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-eb2b25ca-b48a-474f-a80a-948ee3e994c6 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-ecba4a95-5ee1-4748-aef8-27c56f9bbae1-delete_volume'" released by "delete_volume" :: held 9.191s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:36.423397 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:30:36.428017 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:30:36.428471 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:30:36.468562 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (24310cf6-2478-4683-8d77-537553e48ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:36.477641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce6db6f-b6ec-49e4-8f91-8bf0cbbede7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:36.490237 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:30:36.515635 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce6db6f-b6ec-49e4-8f91-8bf0cbbede7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:30:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-36669213',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81c2286c-6fa7-4ec6-aa0a-c558715bda21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:30:36Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:36.538936 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc998812-c9cd-4f9e-b835-668018f355bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:36.551452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc998812-c9cd-4f9e-b835-668018f355bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:36.573803 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae6dedc-6c5f-4137-b23f-306cb48ee672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:36.580851 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae6dedc-6c5f-4137-b23f-306cb48ee672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c2286c-6fa7-4ec6-aa0a-c558715bda21', 'volume_name': 'volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:36.587969 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc856f7-30cb-407a-a9e6-33343876078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:36.592963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc856f7-30cb-407a-a9e6-33343876078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:36.600047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3fef54-23a8-4a2b-800c-05c97d9a1d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:36.601550 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Volume 81c2286c-6fa7-4ec6-aa0a-c558715bda21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21', 'volume_size': 1} Feb 12 21:30:36.601945 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] creating volume 'volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:30:36.603285 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:36.816851 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e59cc8b3-fb49-4909-a645-b117cb52deed tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-dbf986bc-b3be-4620-83fb-02e5e925ea8e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:36.818517 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e59cc8b3-fb49-4909-a645-b117cb52deed tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:38.363516 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:30:38.364576 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:30:38.368408 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3fef54-23a8-4a2b-800c-05c97d9a1d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:38.373211 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a641b48-e25a-4ae7-81d3-013adc54038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:30:38.513191 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Volume volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21 (81c2286c-6fa7-4ec6-aa0a-c558715bda21): created successfully Feb 12 21:30:38.513512 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a641b48-e25a-4ae7-81d3-013adc54038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:30:38.519568 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (24310cf6-2478-4683-8d77-537553e48ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:30:38.673245 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8dc7480e-abbc-4918-8db7-d0fb62e0ebbe tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:30:39.904575 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-81c2286c-6fa7-4ec6-aa0a-c558715bda21-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:40.034818 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:40.342458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:40.342898 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] Volume volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:30:40.578534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-81c2286c-6fa7-4ec6-aa0a-c558715bda21 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:42.719833 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-e59cc8b3-fb49-4909-a645-b117cb52deed tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['adc30c8c-be78-41e0-93b3-bc20ce52e23d', '37150162-e056-4d39-9b53-33629da0b0bb', '511d0ec4-6a51-4632-9198-4bb3ab910008', 'b47b75aa-b528-4056-b376-d02feadd20a7'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:43.158483 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e59cc8b3-fb49-4909-a645-b117cb52deed tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:30:43.163168 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e59cc8b3-fb49-4909-a645-b117cb52deed tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-dbf986bc-b3be-4620-83fb-02e5e925ea8e-delete_snapshot'" released by "delete_snapshot" :: held 6.346s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:43.333911 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-fff64e69-0d36-4dd8-a25f-e61cbd8c8598-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:43.574996 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:43.817228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:43.819520 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:30:44.089975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-fff64e69-0d36-4dd8-a25f-e61cbd8c8598 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:49.558493 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] Created reservations ['047fc288-3073-48ee-8258-9415737c0610', 'b6b0dd61-e49d-419d-9941-7232a7ea6bb2', 'c08286fb-234f-4115-81d0-e68f052ea7f9', '1ad7d90d-6b6a-4aa4-ad66-0934b0e8d488'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:49.864443 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:49.906614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:50.022609 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:50.028931 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:30:50.121601 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5036761e-c98a-4ea2-bded-74b4c7dd8ff3 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-81c2286c-6fa7-4ec6-aa0a-c558715bda21-delete_volume'" released by "delete_volume" :: held 10.217s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:50.894467 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-db2bc108-c046-4572-9fa3-d1d721e57d95-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:51.017298 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:51.537895 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:30:51.538726 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] Volume volume-db2bc108-c046-4572-9fa3-d1d721e57d95 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:30:51.823022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-db2bc108-c046-4572-9fa3-d1d721e57d95 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:30:52.828603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['d384ded7-db09-4b21-a22a-9ee3b191a1b3', '0cef2cc0-02c8-4923-9457-e96271591e0d', '13ca607b-d4ea-481e-b9ea-18e8ebf3ef8f', 'a1a98220-4434-49e2-97b7-b72c49c4eef9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:53.067247 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:53.155668 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:53.229332 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:53.257112 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:30:53.263088 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-a7a44cfc-53a5-42b3-be82-9db451513978 req-0ea1b3e3-7ba8-4182-abbb-5ee38e5c6628 tempest-VolumesBackupsTest-835000994 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:30:53.384849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-3197b875-7c5a-45d3-ba2e-811514d835e0 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-fff64e69-0d36-4dd8-a25f-e61cbd8c8598-delete_volume'" released by "delete_volume" :: held 10.058s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:54.040274 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-a7a44cfc-53a5-42b3-be82-9db451513978 req-0ea1b3e3-7ba8-4182-abbb-5ee38e5c6628 tempest-VolumesBackupsTest-835000994 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.776s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:30:54.040876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-a7a44cfc-53a5-42b3-be82-9db451513978 req-0ea1b3e3-7ba8-4182-abbb-5ee38e5c6628 tempest-VolumesBackupsTest-835000994 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:30:54.169557 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-a7a44cfc-53a5-42b3-be82-9db451513978 req-0ea1b3e3-7ba8-4182-abbb-5ee38e5c6628 tempest-VolumesBackupsTest-835000994 None] Connection info returned from driver {'name': 'volumes/volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'be8285b1-c6e1-4f9d-b01e-dfd449de7346'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:30:54.303365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-7d0fe774-33ee-4c45-a0a9-602dc5703725 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-081b5ebb-4940-4280-adf7-2fd194f5aa6f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:30:54.305131 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7d0fe774-33ee-4c45-a0a9-602dc5703725 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:54.714856 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-a7a44cfc-53a5-42b3-be82-9db451513978 req-0ea1b3e3-7ba8-4182-abbb-5ee38e5c6628 tempest-VolumesBackupsTest-835000994 None] attachment_update completed successfully. Feb 12 21:30:58.730493 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-7d0fe774-33ee-4c45-a0a9-602dc5703725 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['9d712a19-37ef-4b0d-8894-3fead472cab0', '34e3a36a-89d1-40b9-af68-dd38ce07cb8e', 'ced537b2-8dd8-45ea-9369-bd6bd4ff0b8f', 'f11000d5-acc2-4176-a872-0defd5054223'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:59.003917 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7d0fe774-33ee-4c45-a0a9-602dc5703725 tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:30:59.009712 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-7d0fe774-33ee-4c45-a0a9-602dc5703725 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-081b5ebb-4940-4280-adf7-2fd194f5aa6f-delete_snapshot'" released by "delete_snapshot" :: held 4.706s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:30:59.281444 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:30:58Z,data_timestamp=2022-02-12T21:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-365290829',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=22aaf2aa-508d-4fff-adaa-4bdc119bcb23,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4fb7edbcd0864f13be6f5138d1350e12',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d083b81672cd463fb6cce6f8a602bb4f',volume_id=3d099d6f-2ad2-42c9-afe0-4edb1118f461) Feb 12 21:30:59.281800 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] continue_backup in rpcapi backup_id 22aaf2aa-508d-4fff-adaa-4bdc119bcb23 {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:30:59.300602 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] Created reservations ['a8e7b299-6146-44c7-83ac-b827b4dca7fe', 'd8438c9b-489a-45cb-a04b-f267bd777bd8', '70fd3967-5950-463c-acd1-46d583450501', 'f1fab136-55dd-4800-84d7-9a5d84c2793c'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:30:59.470127 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:30:59.612736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:59.815317 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:30:59.891921 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:30:59.923445 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:30:59.958090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-95c3c394-fe73-43bc-a253-8e954d2730bb-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:00.001172 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-26bfc03d-8fbd-464b-9678-538976095d4d tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-db2bc108-c046-4572-9fa3-d1d721e57d95-delete_volume'" released by "delete_volume" :: held 9.107s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:00.120422 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:00.440092 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:00.440552 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-95c3c394-fe73-43bc-a253-8e954d2730bb is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:00.714329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-95c3c394-fe73-43bc-a253-8e954d2730bb {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:00.722906 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.253s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:31:00.723868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '3d099d6f-2ad2-42c9-afe0-4edb1118f461', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:31:00.755198 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] Initialize volume connection completed successfully. Feb 12 21:31:00.845576 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:00.849708 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:00.850204 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:00.871256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (99124c92-0563-47f9-b0ff-33d9bc000800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:00.879407 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffec133-73b8-4bd8-b585-114e81276f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:00.886213 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:00.902358 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffec133-73b8-4bd8-b585-114e81276f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2057646020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ad62e36-7b54-4959-81eb-0ab28a14a060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:01Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:00.907945 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cec74a7-0798-45fe-9f66-15d009c57203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:00.912256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cec74a7-0798-45fe-9f66-15d009c57203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:00.919329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121e47fd-ef73-4560-9812-6744ad63517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:00.923651 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121e47fd-ef73-4560-9812-6744ad63517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad62e36-7b54-4959-81eb-0ab28a14a060', 'volume_name': 'volume-0ad62e36-7b54-4959-81eb-0ab28a14a060', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:00.928877 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e5ef31-d178-4611-a9ec-51f42a870baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:00.933167 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e5ef31-d178-4611-a9ec-51f42a870baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:00.938691 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714428dd-03cd-419e-8422-7b88df8b96ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:00.939991 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Volume 0ad62e36-7b54-4959-81eb-0ab28a14a060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad62e36-7b54-4959-81eb-0ab28a14a060', 'volume_size': 1} Feb 12 21:31:00.940399 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] creating volume 'volume-0ad62e36-7b54-4959-81eb-0ab28a14a060' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:31:00.941404 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:02.110730 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:02.111352 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:02.115178 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714428dd-03cd-419e-8422-7b88df8b96ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad62e36-7b54-4959-81eb-0ab28a14a060', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:02.120901 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8de841-be47-4156-824a-51023b76cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:02.205677 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Volume volume-0ad62e36-7b54-4959-81eb-0ab28a14a060 (0ad62e36-7b54-4959-81eb-0ab28a14a060): created successfully Feb 12 21:31:02.211739 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8de841-be47-4156-824a-51023b76cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:02.217912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (99124c92-0563-47f9-b0ff-33d9bc000800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:02.290444 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6db858ce-695d-4bc6-874a-586fe27cabb2 tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:31:03.422518 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:03.426012 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:03.426459 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:03.464374 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (06f71441-926d-4e8a-9eec-82736176ae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:03.471581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57398247-56ca-4798-a0c4-360a4c086730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:03.479297 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:03.494303 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57398247-56ca-4798-a0c4-360a4c086730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-330079308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4948b0b8-a427-479e-b966-8e0da47cb5f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0ad62e36-7b54-4959-81eb-0ab28a14a060,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:03Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:03.516026 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa6886c-80e0-4a50-a545-9d4b70fbcb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:03.523482 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa6886c-80e0-4a50-a545-9d4b70fbcb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:03.540329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdb9795-2597-4d5a-8a31-e5aa43259358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:03.580552 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdb9795-2597-4d5a-8a31-e5aa43259358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4948b0b8-a427-479e-b966-8e0da47cb5f1', 'volume_name': 'volume-4948b0b8-a427-479e-b966-8e0da47cb5f1', 'volume_size': 1, 'source_volid': '0ad62e36-7b54-4959-81eb-0ab28a14a060', 'source_volstatus': 'available'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:03.590385 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4487107d-eabe-48ba-85ab-5f11e75c525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:03.596175 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4487107d-eabe-48ba-85ab-5f11e75c525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:03.607253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050a73f3-e294-45b9-99e3-7baf4a0c2efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:03.609042 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Volume 4948b0b8-a427-479e-b966-8e0da47cb5f1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4948b0b8-a427-479e-b966-8e0da47cb5f1', 'volume_size': 1, 'source_volid': '0ad62e36-7b54-4959-81eb-0ab28a14a060', 'source_volstatus': 'available'} Feb 12 21:31:03.628711 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:04.063963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] creating snapshot='volume-4948b0b8-a427-479e-b966-8e0da47cb5f1.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:31:07.189657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] cloning 'volume-0ad62e36-7b54-4959-81eb-0ab28a14a060@volume-4948b0b8-a427-479e-b966-8e0da47cb5f1.clone_snap' to 'volume-4948b0b8-a427-479e-b966-8e0da47cb5f1' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:31:07.913844 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['e2b1b2d8-ece8-4e1f-a4f4-38860061ace6', '24a796d3-ad36-49eb-88fd-976bd9ba0ae4', '4fab2f40-d868-4283-ba80-eb6d77f43c08', 'e5eacd65-6af2-46d1-83a8-dfad2a1649dc'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:08.084016 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:08.121019 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:08.218070 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:08.234261 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:31:08.237015 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] Terminate volume connection completed successfully. Feb 12 21:31:08.263398 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cee15500-3c36-47cb-8e31-5bad7b415566 tempest-VolumesBackupsTest-835000994 None] Remove volume export completed successfully. Feb 12 21:31:08.350882 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-6858d538-09a6-4592-948f-62348e980411 tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-95c3c394-fe73-43bc-a253-8e954d2730bb-delete_volume'" released by "delete_volume" :: held 8.389s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:08.634963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-aacc142f-bac9-4d58-9705-49f2b86e3a0a-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:08.767889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:09.057208 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:09.279468 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:09.295359 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Volume volume-0ad62e36-7b54-4959-81eb-0ab28a14a060 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:09.296785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:09.297229 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:10.156193 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:31:10.157304 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050a73f3-e294-45b9-99e3-7baf4a0c2efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4948b0b8-a427-479e-b966-8e0da47cb5f1', 'volume_size': 1, 'source_volid': '0ad62e36-7b54-4959-81eb-0ab28a14a060', 'source_volstatus': 'available'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:10.162340 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff171ec7-2381-45dc-856a-46acd5633c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:10.277747 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Volume volume-4948b0b8-a427-479e-b966-8e0da47cb5f1 (4948b0b8-a427-479e-b966-8e0da47cb5f1): created successfully Feb 12 21:31:10.283173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff171ec7-2381-45dc-856a-46acd5633c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:10.302553 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (06f71441-926d-4e8a-9eec-82736176ae13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:10.380692 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3f7aa64a-5a0e-4eac-9eaa-5bac5107336f tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:31:11.522076 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:31:11.522995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:11.613329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:11.700254 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:11.708433 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-a0563b90-dbb2-40c9-a8a7-2ea0c6e75da1 tempest-BackendsCapabilitiesAdminTestsJSON-1432816949 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:0d21d973-c3ac-4273-9bcc-58b8c7c60701:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134690) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Feb 12 21:31:11.763493 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-be19dfaa-bbf0-4485-add3-f872cad69ae5 tempest-BackendsCapabilitiesAdminTestsJSON-1432816949 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:0d21d973-c3ac-4273-9bcc-58b8c7c60701:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=134690) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Feb 12 21:31:12.087049 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:12.091656 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:12.092155 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:12.113032 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (9afa2116-0938-42eb-a530-d01c95290823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:12.123127 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff65671f-a312-4740-8756-ce3ecb541b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:12.131400 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:12.159323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff65671f-a312-4740-8756-ce3ecb541b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1979060375',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79d38780-c542-4dc2-bb00-512c443d76e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:12Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:12.171810 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f504cf5-53b6-4dd0-8625-17b2719a30fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:12.177700 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f504cf5-53b6-4dd0-8625-17b2719a30fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:12.184976 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee1cf90-abc2-4f1c-bdbe-29efe06c7df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:12.190182 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee1cf90-abc2-4f1c-bdbe-29efe06c7df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d38780-c542-4dc2-bb00-512c443d76e6', 'volume_name': 'volume-79d38780-c542-4dc2-bb00-512c443d76e6', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:12.198302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a679a4be-c2d5-4153-8ab8-8a14ec24c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:12.204105 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a679a4be-c2d5-4153-8ab8-8a14ec24c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:12.209705 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ce6b94-1dce-4a44-aea7-f9a078c3c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:12.211001 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Volume 79d38780-c542-4dc2-bb00-512c443d76e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d38780-c542-4dc2-bb00-512c443d76e6', 'volume_size': 1} Feb 12 21:31:12.211564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] creating volume 'volume-79d38780-c542-4dc2-bb00-512c443d76e6' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:31:12.212702 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:13.468798 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:13.469441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:13.473340 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ce6b94-1dce-4a44-aea7-f9a078c3c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d38780-c542-4dc2-bb00-512c443d76e6', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:13.478637 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9c07ad-9391-40ba-bc0f-48a25645787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:13.576811 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Volume volume-79d38780-c542-4dc2-bb00-512c443d76e6 (79d38780-c542-4dc2-bb00-512c443d76e6): created successfully Feb 12 21:31:13.580992 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9c07ad-9391-40ba-bc0f-48a25645787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:13.590388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (9afa2116-0938-42eb-a530-d01c95290823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:13.713902 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-480f4c0f-1cee-4fd9-ba27-a01eca746764 tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:31:14.386050 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-79d38780-c542-4dc2-bb00-512c443d76e6-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:14.498680 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:14.948337 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:14.949984 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] Volume volume-79d38780-c542-4dc2-bb00-512c443d76e6 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:15.154905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-79d38780-c542-4dc2-bb00-512c443d76e6 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:17.617257 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:31:17.862889 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] deleting parent snapshot volume-aacc142f-bac9-4d58-9705-49f2b86e3a0a.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:31:22.999684 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['fbdee2e7-00d8-41a1-ae36-7ea13e7c923a', 'cb3d1697-cbd0-4ee8-bc9b-5df0e1120af1', '2f14b84e-729b-49ab-a953-abd22bc714fa', '521aa0a8-da62-4d7d-83b7-8cd02c8435cd'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:23.275523 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:23.343559 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:23.398206 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:23.419628 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:31:23.604917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] Created reservations ['d3129c28-6e60-4c1a-9d3d-a5737a8133a3', '0bad102c-9cff-4841-9311-63c89dbd003a', 'ef9e93db-69b9-4c67-b619-7ad8a90be5fb', '01f8bcd3-77b0-4682-ba0f-f737d5993fc8'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:23.637881 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a13198c7-ec8a-45a9-965a-4ab7efb87c5f tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-aacc142f-bac9-4d58-9705-49f2b86e3a0a-delete_volume'" released by "delete_volume" :: held 15.003s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:23.830352 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:23.885956 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:23.949404 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:23.963762 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:31:23.974902 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-39200582-d551-4a68-b13f-34dabeb30d7f tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-0e2af5f2-6f44-4382-996b-59776a0542b3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:23.978007 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-39200582-d551-4a68-b13f-34dabeb30d7f tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:24.229577 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-4948b0b8-a427-479e-b966-8e0da47cb5f1-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:24.268203 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2beff1a9-5f7a-4e19-afd7-f4cd9e759df0 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-79d38780-c542-4dc2-bb00-512c443d76e6-delete_volume'" released by "delete_volume" :: held 9.882s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:24.333501 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:24.719772 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:25.007061 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-4948b0b8-a427-479e-b966-8e0da47cb5f1 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:25.030538 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-6a092c11-4a4c-42e2-aca8-2588acf176f4 req-bde79fee-13d5-485e-b11f-7643e48af17c tempest-VolumesBackupsTest-835000994 None] Terminate volume connection completed successfully. Feb 12 21:31:25.031027 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-6a092c11-4a4c-42e2-aca8-2588acf176f4 req-bde79fee-13d5-485e-b11f-7643e48af17c tempest-VolumesBackupsTest-835000994 None] Deleting attachment be8285b1-c6e1-4f9d-b01e-dfd449de7346. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:31:27.389606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:27.393067 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:27.393554 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:27.414470 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Flow 'volume_create_manager' (8aa327a5-0cba-4f30-937e-810b1c3bcb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:27.422139 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8940a245-504d-422a-9ec3-de87e9a2c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:27.428650 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:27.450255 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8940a245-504d-422a-9ec3-de87e9a2c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1658524417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=55a30bb7-cacf-40b7-b848-bf47e3ab120b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db96fc9f4346466a846036c140be9f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:27Z,use_quota=True,user_id='63e71e3d9ed845d3888cd11bbe86fff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:27.457477 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ab8026-0dbe-4526-81b8-2a3e109ca7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:27.462813 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ab8026-0dbe-4526-81b8-2a3e109ca7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:27.468180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e4cd1f-7d67-4331-9859-4297e6d1bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:27.472601 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e4cd1f-7d67-4331-9859-4297e6d1bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a30bb7-cacf-40b7-b848-bf47e3ab120b', 'volume_name': 'volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:27.478037 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde0fd02-deb6-4c78-9f07-0ea6ad411ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:27.482249 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde0fd02-deb6-4c78-9f07-0ea6ad411ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:27.487209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa5508-8aba-481b-96af-9dd0ac4f25ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:27.488317 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Volume 55a30bb7-cacf-40b7-b848-bf47e3ab120b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b', 'volume_size': 1} Feb 12 21:31:27.488709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] creating volume 'volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:31:27.489768 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:28.534221 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:28.535393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:28.539502 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fa5508-8aba-481b-96af-9dd0ac4f25ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:28.544169 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d93735f-e6d9-4289-8daa-a29d7cd5a558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:28.651548 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Volume volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b (55a30bb7-cacf-40b7-b848-bf47e3ab120b): created successfully Feb 12 21:31:28.656456 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d93735f-e6d9-4289-8daa-a29d7cd5a558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:28.663928 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Flow 'volume_create_manager' (8aa327a5-0cba-4f30-937e-810b1c3bcb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:28.757923 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-17175cb2-9a45-43bb-8222-b5e3db7f00a3 tempest-SnapshotsActionsTest-960797822 None] Created volume successfully. Feb 12 21:31:29.268770 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-39200582-d551-4a68-b13f-34dabeb30d7f tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['107c316f-f876-4757-b455-9ea8ad2efae7', '297d6378-664d-46ca-8d93-f4bad7d2e243', '29d91a6e-d780-4a63-8ea6-eecb62bdf926', '6de8640b-a6f9-46fb-a781-21e6b753cbc5'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:29.725707 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-39200582-d551-4a68-b13f-34dabeb30d7f tempest-VolumesSnapshotTestJSON-1959179807 None] Delete snapshot completed successfully. Feb 12 21:31:29.735637 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-39200582-d551-4a68-b13f-34dabeb30d7f tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-0e2af5f2-6f44-4382-996b-59776a0542b3-delete_snapshot'" released by "delete_snapshot" :: held 5.756s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:30.289183 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4b605d36-fd64-4a2c-aef5-38afce0d8571 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:30.576474 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-3d0f4abb-5903-44b8-87d3-462cd29d1ffe-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:30.642162 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:30.911950 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:30.913042 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] Volume volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:31.160661 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] deleting rbd volume volume-3d0f4abb-5903-44b8-87d3-462cd29d1ffe {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:31.255438 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-3d099d6f-2ad2-42c9-afe0-4edb1118f461-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:31.366217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:34.467864 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] Volume volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:35.182691 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] deleting rbd volume volume-3d099d6f-2ad2-42c9-afe0-4edb1118f461 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:35.184736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:31:35.440228 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] Volume volume-0ad62e36-7b54-4959-81eb-0ab28a14a060 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:35.440888 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] deleting parent snapshot volume-4948b0b8-a427-479e-b966-8e0da47cb5f1.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:31:39.485917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] Created reservations ['d6a827b5-39bc-4a99-b873-2a662c40b839', 'db1a1a8a-b5b0-4f9a-8d2f-e6d97914a8a2', '7dd3ce2e-13ad-4cd1-9310-8ca98ede5a93', '131c7b42-1c7f-4ce8-a1b5-25563dce8e5a'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:39.488981 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] Created reservations ['ba3e366d-c4f9-4982-b68c-8c407b735752', 'ddab1365-4912-4f6e-82df-549c112112a8', 'a4827e2f-b924-4b5c-b0fc-5f65b5c8ad49', 'cef0ee78-a944-428c-af88-2787726e7d88'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:39.700476 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:39.727213 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:39.758048 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:39.766478 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] Deleted volume successfully. Feb 12 21:31:39.858140 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:39.900043 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:39.934954 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:39.940341 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:31:39.944653 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-cecfb5a0-11ef-41d1-a61f-e533970ac59e tempest-VolumesSnapshotTestJSON-1959179807 None] Lock "b'cinder-3d0f4abb-5903-44b8-87d3-462cd29d1ffe-delete_volume'" released by "delete_volume" :: held 9.368s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:40.044425 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-71161231-c98e-4f48-a543-74508e2baa8a tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-4948b0b8-a427-479e-b966-8e0da47cb5f1-delete_volume'" released by "delete_volume" :: held 15.815s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:40.234869 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-4b605d36-fd64-4a2c-aef5-38afce0d8571 tempest-SnapshotsActionsTest-960797822 None] Create snapshot completed successfully Feb 12 21:31:41.177376 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:41.180919 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:41.181906 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:41.201680 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (06f65b12-109c-47c5-8ae6-10e66f9078b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:41.208800 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35113316-885b-4cb1-a0c2-b3cc13c45309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:41.216679 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:41.233161 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35113316-885b-4cb1-a0c2-b3cc13c45309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1575753951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1a31b23-a375-45ff-a0d1-5dfc41f85157,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:41Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:41.239507 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8beb104-2c4f-4577-9df8-a03f6226f4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:41.246341 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8beb104-2c4f-4577-9df8-a03f6226f4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:41.253654 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae7b023-f060-4213-a9dc-c1f403a292ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:41.371416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae7b023-f060-4213-a9dc-c1f403a292ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1a31b23-a375-45ff-a0d1-5dfc41f85157', 'volume_name': 'volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:41.377219 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5146b99d-389c-4cb1-8a4a-1a410580b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:41.381922 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5146b99d-389c-4cb1-8a4a-1a410580b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:41.387979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba366b8-4a24-410a-9b57-f9ec68cf4f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:41.392904 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Volume c1a31b23-a375-45ff-a0d1-5dfc41f85157: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:31:41.392904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Cloning c1a31b23-a375-45ff-a0d1-5dfc41f85157 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:31:41.404148 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:41.483303 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-83ef4c82-410c-4c6f-811a-93f6440a9700 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:41.647173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 31, 41, 410104)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:31:41.647541 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:31:41.647935 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:31:41.658383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.249s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:41.658383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:31:41.746566 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 31, 41, 658443)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:31:41.747103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:31:41.751434 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:31:41.761758 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:42.075155 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] creating snapshot='volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:31:44.223697 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157.clone_snap' to 'volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:31:44.367030 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] Created reservations ['a78985c7-6265-4991-a2c6-f4bfbb8ac064', '8eeadb22-1496-4cbe-b488-9662285d3c77', 'dcbee5f8-c7f0-4678-8436-03e2e063923b', 'b47bd6c0-4517-4ac6-a5c6-16b5492e3cf2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:44.536313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:44.611430 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:44.658218 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:31:44.663456 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] Deleted volume successfully. Feb 12 21:31:44.768985 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1b740b3e-e712-4136-a443-e75207102259 tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-3d099d6f-2ad2-42c9-afe0-4edb1118f461-delete_volume'" released by "delete_volume" :: held 13.514s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:45.583106 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-83ef4c82-410c-4c6f-811a-93f6440a9700 tempest-SnapshotsActionsTest-960797822 None] Create snapshot completed successfully Feb 12 21:31:46.010096 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:46.016862 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:46.017411 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:46.043826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Flow 'volume_create_manager' (8dd7df73-37ee-4181-96ec-28e2d5dab283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:46.051832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2776370b-061d-41d4-823e-c5f63b11a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:46.059230 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:46.075542 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2776370b-061d-41d4-823e-c5f63b11a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1904384275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8634339a-63d4-437c-aab7-c9cd3446b531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb7edbcd0864f13be6f5138d1350e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:46Z,use_quota=True,user_id='d083b81672cd463fb6cce6f8a602bb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:46.082025 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeb0398-b98b-4238-94a3-6c2814471644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:46.088544 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeb0398-b98b-4238-94a3-6c2814471644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:46.094923 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45c604e-f45f-4006-bff6-6fc25d534fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:46.238110 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:46.239650 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:46.240051 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:47.101566 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:31:47.104316 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Marking volume c1a31b23-a375-45ff-a0d1-5dfc41f85157 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:31:47.140702 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-40edde59-2b5a-443c-9bba-351e9976f9c7 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-6d3c26b0-f387-4c1e-b3f0-fa1c8960c6cd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:47.142571 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40edde59-2b5a-443c-9bba-351e9976f9c7 tempest-SnapshotsActionsTest-1992154030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:47.316286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45c604e-f45f-4006-bff6-6fc25d534fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8634339a-63d4-437c-aab7-c9cd3446b531', 'volume_name': 'volume-8634339a-63d4-437c-aab7-c9cd3446b531', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:47.324143 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6376f9-d5d7-4dae-889b-e58630591999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:47.328667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6376f9-d5d7-4dae-889b-e58630591999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:47.333920 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2629e500-577e-430f-b413-1fa8bc44bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:47.335219 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Volume 8634339a-63d4-437c-aab7-c9cd3446b531: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8634339a-63d4-437c-aab7-c9cd3446b531', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:31:47.336083 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Cloning 8634339a-63d4-437c-aab7-c9cd3446b531 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:31:47.340617 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to c1a31b23-a375-45ff-a0d1-5dfc41f85157. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:31:47.342291 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Creating volume glance metadata for volume c1a31b23-a375-45ff-a0d1-5dfc41f85157 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:31:47.350998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:47.466286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 31, 47, 368214)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:31:47.466286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:31:47.466286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:31:47.470458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.119s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:47.471411 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:31:47.480738 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 31, 47, 476509)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:31:47.481244 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:31:47.482592 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:31:47.501707 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:47.908162 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] creating snapshot='volume-8634339a-63d4-437c-aab7-c9cd3446b531.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:31:50.654583 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-8634339a-63d4-437c-aab7-c9cd3446b531.clone_snap' to 'volume-8634339a-63d4-437c-aab7-c9cd3446b531' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:31:50.674860 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba366b8-4a24-410a-9b57-f9ec68cf4f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:50.694794 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710ff821-ac95-47b0-9a36-c01d8c1c16de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:50.811555 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Volume volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157 (c1a31b23-a375-45ff-a0d1-5dfc41f85157): created successfully Feb 12 21:31:50.816124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710ff821-ac95-47b0-9a36-c01d8c1c16de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:50.838458 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (06f65b12-109c-47c5-8ae6-10e66f9078b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:51.002963 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b34606f9-1d63-48ae-834b-cd4c36044e2a tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:31:51.372773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:51.377449 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:51.378077 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:51.423644 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Flow 'volume_create_manager' (dd993e02-ca5d-4487-ac5d-f5107a94219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:51.449801 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa7c612-2441-40a3-8534-69329abb2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:51.456974 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:51.474761 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa7c612-2441-40a3-8534-69329abb2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-800665055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f158aef-d388-47ec-8594-31a8ad061862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4ee41bf3cb4b6894370d8f5baa0428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:51Z,use_quota=True,user_id='00c9be2bfdde46fe8f1473a71577b47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45497bda-9369-49c3-9f9b-059f1f01bb43),volume_type_id=45497bda-9369-49c3-9f9b-059f1f01bb43)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:51.485247 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e14351-1600-481c-b694-1c1b4d8c260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:51.494507 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e14351-1600-481c-b694-1c1b4d8c260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:51.502018 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f68d27b-3a1b-4dfc-8f6f-dfc78d4c493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:51.507904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f68d27b-3a1b-4dfc-8f6f-dfc78d4c493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f158aef-d388-47ec-8594-31a8ad061862', 'volume_name': 'volume-7f158aef-d388-47ec-8594-31a8ad061862', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:51.516858 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf7929d-ca5b-4a32-8597-0a52f5abacc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:51.522111 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf7929d-ca5b-4a32-8597-0a52f5abacc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:51.528729 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08677a3f-88fe-4bf9-8739-a068cfe14570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:51.531669 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Volume 7f158aef-d388-47ec-8594-31a8ad061862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f158aef-d388-47ec-8594-31a8ad061862', 'volume_size': 1} Feb 12 21:31:51.532135 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] creating volume 'volume-7f158aef-d388-47ec-8594-31a8ad061862' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:31:51.533347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:52.720022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] extra_specs: {} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:52.721298 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] extra_specs: {} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:52.726056 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08677a3f-88fe-4bf9-8739-a068cfe14570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f158aef-d388-47ec-8594-31a8ad061862', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:52.743180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380405be-9425-4113-b919-ae82ad596a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:52.839627 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Volume volume-7f158aef-d388-47ec-8594-31a8ad061862 (7f158aef-d388-47ec-8594-31a8ad061862): created successfully Feb 12 21:31:52.843643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380405be-9425-4113-b919-ae82ad596a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:52.857938 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Flow 'volume_create_manager' (dd993e02-ca5d-4487-ac5d-f5107a94219a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:52.948817 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ce5baff1-f3ed-457c-9554-b81bd220740e tempest-VolumeTypesAccessTest-1935498138 None] Created volume successfully. Feb 12 21:31:53.484568 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:53.491673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:53.493911 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:54.122286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:31:54.124023 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Marking volume 8634339a-63d4-437c-aab7-c9cd3446b531 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:31:54.239087 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 8634339a-63d4-437c-aab7-c9cd3446b531. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:31:54.239606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Creating volume glance metadata for volume 8634339a-63d4-437c-aab7-c9cd3446b531 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:31:54.277235 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:54.280657 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:54.281106 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:54.301564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (0df51b54-e118-475f-b4b5-58580bf55aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:54.308785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eae8a46-0b68-4b84-9bb6-0e7428f93ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:54.332895 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:54.352307 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eae8a46-0b68-4b84-9bb6-0e7428f93ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1750567667',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d2a71373-3fa1-445e-bb8c-7c3b7bdceef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc1d2c29e394141917452e678c09076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:53Z,use_quota=True,user_id='79443b05529a4982aa2126e89ac50d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:54.368662 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d4a437-2dd6-4cec-b9f5-b5088445ee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:54.368662 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d4a437-2dd6-4cec-b9f5-b5088445ee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:54.375525 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96febdb1-da6c-4912-b8e4-bfb499ebf98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:54.380885 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96febdb1-da6c-4912-b8e4-bfb499ebf98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a71373-3fa1-445e-bb8c-7c3b7bdceef3', 'volume_name': 'volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:54.387872 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0b7814-3cb8-40f3-a043-f6b47b34c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:54.393313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0b7814-3cb8-40f3-a043-f6b47b34c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:54.398916 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d65b2b-0072-455e-869e-9d8d221b763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:54.401132 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Volume d2a71373-3fa1-445e-bb8c-7c3b7bdceef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3', 'volume_size': 1} Feb 12 21:31:54.401669 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] creating volume 'volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:31:54.402823 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:54.507809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Lock "b'cinder-7f158aef-d388-47ec-8594-31a8ad061862-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:54.598049 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2629e500-577e-430f-b413-1fa8bc44bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8634339a-63d4-437c-aab7-c9cd3446b531', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:54.607761 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf58b87-688e-40b5-8b02-7d8947c9f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:54.655736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:54.867675 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:54.868106 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Volume volume-7f158aef-d388-47ec-8594-31a8ad061862 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:55.115292 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] deleting rbd volume volume-7f158aef-d388-47ec-8594-31a8ad061862 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:55.129193 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Volume volume-8634339a-63d4-437c-aab7-c9cd3446b531 (8634339a-63d4-437c-aab7-c9cd3446b531): created successfully Feb 12 21:31:55.140317 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf58b87-688e-40b5-8b02-7d8947c9f51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:55.165212 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Flow 'volume_create_manager' (8dd7df73-37ee-4181-96ec-28e2d5dab283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:55.271275 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:31:55.271841 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:31:55.276441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d65b2b-0072-455e-869e-9d8d221b763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:55.281895 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814c60f-706c-404b-92a6-26ba80348bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:55.331167 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8575fd31-1182-4b5c-9eb1-ce0e687bad47 tempest-VolumesBackupsTest-835000994 None] Created volume successfully. Feb 12 21:31:55.433808 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-40edde59-2b5a-443c-9bba-351e9976f9c7 tempest-SnapshotsActionsTest-1992154030 None] Created reservations ['4fb7635c-67f7-4515-a589-7de5bca6567e', '9c2a9f5d-a288-49fa-bc4c-d417ea92007d', '2168bfe1-03ab-485f-943c-c9e2215123e7', '9ffc9362-cae6-4149-ad4c-aa4f59e38a8f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:31:55.454309 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Volume volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3 (d2a71373-3fa1-445e-bb8c-7c3b7bdceef3): created successfully Feb 12 21:31:55.458827 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814c60f-706c-404b-92a6-26ba80348bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:55.465277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Flow 'volume_create_manager' (0df51b54-e118-475f-b4b5-58580bf55aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:55.639708 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-94874ec7-64ef-4e60-9d25-5c5979b1165e tempest-VolumesGetTest-1942455120 None] Created volume successfully. Feb 12 21:31:55.782188 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-40edde59-2b5a-443c-9bba-351e9976f9c7 tempest-SnapshotsActionsTest-1992154030 None] Delete snapshot completed successfully. Feb 12 21:31:55.789550 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-40edde59-2b5a-443c-9bba-351e9976f9c7 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-6d3c26b0-f387-4c1e-b3f0-fa1c8960c6cd-delete_snapshot'" released by "delete_snapshot" :: held 8.648s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:56.343093 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:31:55Z,data_timestamp=2022-02-12T21:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1073773826',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=91a00afe-73f8-4fb5-b868-f5cd70a56fc7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4fb7edbcd0864f13be6f5138d1350e12',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d083b81672cd463fb6cce6f8a602bb4f',volume_id=8634339a-63d4-437c-aab7-c9cd3446b531) Feb 12 21:31:56.348858 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] continue_backup in rpcapi backup_id 91a00afe-73f8-4fb5-b868-f5cd70a56fc7 {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:31:56.558646 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:31:56.652607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:56.775667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:57.028234 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:31:57.028572 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] Volume volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:31:57.319712 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:31:57.455191 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-861da007-593f-4914-8d04-198b3e27d897 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:31:57.876081 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.317s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:31:57.877584 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8634339a-63d4-437c-aab7-c9cd3446b531', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '8634339a-63d4-437c-aab7-c9cd3446b531', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:31:57.897786 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] Initialize volume connection completed successfully. Feb 12 21:31:59.104736 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:31:59.111478 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:31:59.112203 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:31:59.166396 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Flow 'volume_create_manager' (1f29304c-b52a-45a3-83d9-4bdc259f3edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:31:59.173499 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50ff3c2-1354-49e6-abb1-2822ec9924c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:59.180251 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:31:59.203631 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50ff3c2-1354-49e6-abb1-2822ec9924c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1482330131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3511a55-12b4-476c-b22f-f927dc31e59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfcb9d238a52483a94553e900468a87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:31:59Z,use_quota=True,user_id='dd1a01a1f86a4f4ca3997db04ed1b4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:59.209929 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621e8e0d-ea10-4dee-b39d-6dd704d14125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:59.217730 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621e8e0d-ea10-4dee-b39d-6dd704d14125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:59.224124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a2afc6-5b56-42ee-b76f-d4eb763af4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:59.365856 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a2afc6-5b56-42ee-b76f-d4eb763af4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3511a55-12b4-476c-b22f-f927dc31e59a', 'volume_name': 'volume-b3511a55-12b4-476c-b22f-f927dc31e59a', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:59.372405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2a224b-a133-42b8-90a0-168c2d3a813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:59.378741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2a224b-a133-42b8-90a0-168c2d3a813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:31:59.392264 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5849297-4160-4d32-91f2-7ee985a02c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:31:59.392264 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Volume b3511a55-12b4-476c-b22f-f927dc31e59a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3511a55-12b4-476c-b22f-f927dc31e59a', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:31:59.392501 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Cloning b3511a55-12b4-476c-b22f-f927dc31e59a from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:31:59.399576 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:31:59.530792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 31, 59, 404545)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:31:59.535195 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:31:59.535195 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:31:59.536119 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.137s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:31:59.537049 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:31:59.645453 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 31, 59, 547633)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:31:59.645809 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:31:59.646265 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:31:59.664198 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:00.172546 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] creating snapshot='volume-b3511a55-12b4-476c-b22f-f927dc31e59a.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:32:04.705229 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-b3511a55-12b4-476c-b22f-f927dc31e59a.clone_snap' to 'volume-b3511a55-12b4-476c-b22f-f927dc31e59a' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:32:04.738142 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1389597508 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1389597508, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:32:04.739200 ncdv-master-1 cinder-volume[134690]: WARNING cinder.quota [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1389597508 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1389597508, it is now deprecated. Please use the default quota class for default quota. Feb 12 21:32:04.816469 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Created reservations ['fbe5f3ad-08b2-42f5-8243-333f528efdc0', '4fe47426-5232-48d9-a037-c5af755f1d4a', 'e9de3ca2-2981-464c-aa84-b1f622fc675d', '59b07161-fac6-4421-8afc-c39fcb0adc24'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:32:04.999084 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:05.032361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:05.066284 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:32:05.070827 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Deleted volume successfully. Feb 12 21:32:05.143540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f7020115-e1a1-4b7a-9bc9-ba0c17efdc7b tempest-VolumeTypesAccessTest-1935498138 None] Lock "b'cinder-7f158aef-d388-47ec-8594-31a8ad061862-delete_volume'" released by "delete_volume" :: held 10.632s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:32:06.155796 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-861da007-593f-4914-8d04-198b3e27d897 tempest-SnapshotsActionsTest-960797822 None] Create snapshot completed successfully Feb 12 21:32:06.713434 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-613bff05-90c0-4ff3-b1ce-f391c4b2aae0 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-288f5b4f-5c9b-46bd-a6d2-ec8917edfff4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:32:06.715819 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-613bff05-90c0-4ff3-b1ce-f391c4b2aae0 tempest-SnapshotsActionsTest-1992154030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:07.926040 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] Created reservations ['6584533b-e9e2-43b4-b5ca-a726a488931d', '8d2672c9-1f89-43ab-a96b-059fa16fd086', '3f6786d6-492f-4365-bddd-f96f742eaf8e', '7525e537-26da-4b6a-9461-a5b779303e04'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:32:08.184456 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:32:08.186346 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:32:08.186975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:32:09.492585 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:32:09.495119 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Marking volume b3511a55-12b4-476c-b22f-f927dc31e59a as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:32:09.524329 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-c1a31b23-a375-45ff-a0d1-5dfc41f85157-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:32:09.594967 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to b3511a55-12b4-476c-b22f-f927dc31e59a. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:32:09.596963 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Creating volume glance metadata for volume b3511a55-12b4-476c-b22f-f927dc31e59a backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:32:09.626306 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:09.984771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:10.037188 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:32:10.047906 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:32:10.080166 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:11.263679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:32:11.655356 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:32:11.667819 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:32:11.673685 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:11.824721 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:12.023393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:32:12.038422 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-df4847b3-7224-4250-be82-f5ae7080e9c0 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-d2a71373-3fa1-445e-bb8c-7c3b7bdceef3-delete_volume'" released by "delete_volume" :: held 15.386s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:32:12.175196 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5849297-4160-4d32-91f2-7ee985a02c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3511a55-12b4-476c-b22f-f927dc31e59a', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:12.182379 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaca795-4288-4d2d-b1c5-dbc7e9d627a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:12.313243 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Volume volume-b3511a55-12b4-476c-b22f-f927dc31e59a (b3511a55-12b4-476c-b22f-f927dc31e59a): created successfully Feb 12 21:32:12.317844 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaca795-4288-4d2d-b1c5-dbc7e9d627a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:12.324301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Flow 'volume_create_manager' (1f29304c-b52a-45a3-83d9-4bdc259f3edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:32:12.427886 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b88f0444-e02a-4d9c-bec5-12ec2c828875 tempest-TestVolumeBackupRestore-1020972158 None] Created volume successfully. Feb 12 21:32:13.853885 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:32:13Z,data_timestamp=2022-02-12T21:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=278e59a9-78b0-48d1-ab85-d144c12c2de5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='cfcb9d238a52483a94553e900468a87c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='dd1a01a1f86a4f4ca3997db04ed1b4f8',volume_id=b3511a55-12b4-476c-b22f-f927dc31e59a) Feb 12 21:32:13.854719 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] continue_backup in rpcapi backup_id 278e59a9-78b0-48d1-ab85-d144c12c2de5 {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:32:14.029287 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:32:14.875169 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.846s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:32:14.876116 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b3511a55-12b4-476c-b22f-f927dc31e59a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'b3511a55-12b4-476c-b22f-f927dc31e59a', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:32:14.889673 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] Initialize volume connection completed successfully. Feb 12 21:32:15.163059 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:32:15.167463 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:32:15.167961 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:32:15.192817 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Flow 'volume_create_manager' (a890ff81-d158-406f-b4ba-555d1403df1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:32:15.202035 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5003a9a4-f105-44f4-9f7d-855287c2fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:15.214872 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:32:15.237144 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5003a9a4-f105-44f4-9f7d-855287c2fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-570689832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3e2080d8-56fd-43ff-a909-f621b9fd5444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdac3100e374c09bbb793c83e7fd52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:32:15Z,use_quota=True,user_id='194ff6deb33c4798a71a7218d83bf74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:15.243131 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fa4a34-e141-4214-8a44-7888efc09be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:15.248665 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fa4a34-e141-4214-8a44-7888efc09be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:15.254541 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46ffdae-9b6c-41ba-b12c-09138644d2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:15.259776 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46ffdae-9b6c-41ba-b12c-09138644d2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2080d8-56fd-43ff-a909-f621b9fd5444', 'volume_name': 'volume-3e2080d8-56fd-43ff-a909-f621b9fd5444', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:15.266858 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122c1adb-524d-4028-826b-ab567f5b06b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:15.273122 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122c1adb-524d-4028-826b-ab567f5b06b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:15.277739 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a35a29-c29b-4371-94ca-e89393207cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:15.278930 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Volume 3e2080d8-56fd-43ff-a909-f621b9fd5444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2080d8-56fd-43ff-a909-f621b9fd5444', 'volume_size': 1} Feb 12 21:32:15.279290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] creating volume 'volume-3e2080d8-56fd-43ff-a909-f621b9fd5444' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:32:15.280440 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:15.867069 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-613bff05-90c0-4ff3-b1ce-f391c4b2aae0 tempest-SnapshotsActionsTest-1992154030 None] Created reservations ['069f4440-8c45-44fb-b512-44aaa86d93d7', '1f331a30-3188-4c30-b075-fc203912a50a', '7af72597-4167-4b86-8c95-4cfa90c4f2fc', 'f60757fd-fb33-4a52-b839-3992a2be426b'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:32:16.604980 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-613bff05-90c0-4ff3-b1ce-f391c4b2aae0 tempest-SnapshotsActionsTest-1992154030 None] Delete snapshot completed successfully. Feb 12 21:32:16.610365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-613bff05-90c0-4ff3-b1ce-f391c4b2aae0 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-288f5b4f-5c9b-46bd-a6d2-ec8917edfff4-delete_snapshot'" released by "delete_snapshot" :: held 9.898s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:32:17.368222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-312beb85-21aa-4437-b7c5-a8fb0f2752a7 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:18.565764 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:32:18.566446 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:32:18.570183 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a35a29-c29b-4371-94ca-e89393207cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2080d8-56fd-43ff-a909-f621b9fd5444', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:18.575788 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c874d2a6-af22-4360-8063-78f2c43c402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:18.662303 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Volume volume-3e2080d8-56fd-43ff-a909-f621b9fd5444 (3e2080d8-56fd-43ff-a909-f621b9fd5444): created successfully Feb 12 21:32:18.666208 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c874d2a6-af22-4360-8063-78f2c43c402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:18.671879 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Flow 'volume_create_manager' (a890ff81-d158-406f-b4ba-555d1403df1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:32:18.758685 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5d1942be-5be6-4e47-9a17-f5783c64eee3 tempest-VolumesTransfersTest-1979150386 None] Created volume successfully. Feb 12 21:32:20.235864 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d44bf92c-b748-45d8-b3c9-b42659ed1c3c tempest-VolumesTransfersTest-1962995033 None] Transfer volume completed successfully. Feb 12 21:32:21.307758 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] Lock "b'cinder-3e2080d8-56fd-43ff-a909-f621b9fd5444-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:32:21.462140 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:21.844797 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:32:21.845570 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] Volume volume-3e2080d8-56fd-43ff-a909-f621b9fd5444 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:32:22.667581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] deleting rbd volume volume-3e2080d8-56fd-43ff-a909-f621b9fd5444 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:32:23.919438 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-312beb85-21aa-4437-b7c5-a8fb0f2752a7 tempest-SnapshotsActionsTest-960797822 None] Create snapshot completed successfully Feb 12 21:32:24.733478 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f1a9032f-f2b8-4a65-a253-551fc0eaceb1 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-08da7df1-ad40-4a1a-9080-d25152c8f9da-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:32:24.734959 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f1a9032f-f2b8-4a65-a253-551fc0eaceb1 tempest-SnapshotsActionsTest-1992154030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:27.015096 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:32:28.026245 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] deleting parent snapshot volume-c1a31b23-a375-45ff-a0d1-5dfc41f85157.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:32:39.216137 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] Created reservations ['6103a43b-8cbc-4c40-b8c9-08c9e9cf2eb9', 'a57c5d79-181f-41bb-8977-ec72bb885558', 'd2c90250-e97d-4aa2-8e48-bcb35a4b0c86', '0e0cebba-1c6e-4b55-84c3-7a79dd6294a9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:32:39.220023 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] Created reservations ['7bc7291e-d0be-4671-9011-f9b052c6cb43', '161d9a90-acfd-4b75-a3db-b8c947252838', '3899b3f2-82cd-4676-b950-da4a3c166c9f', '620b7499-2a52-442d-ad30-a0fcb9346702'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:32:39.442859 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:39.466032 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:39.490766 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:32:39.496427 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:32:39.570670 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:39.690671 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:39.727961 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:32:39.727961 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] Deleted volume successfully. Feb 12 21:32:39.742272 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-18a83caf-4639-4400-bdef-6372d27dd6a6 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-c1a31b23-a375-45ff-a0d1-5dfc41f85157-delete_volume'" released by "delete_volume" :: held 30.218s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:32:39.745754 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-0ad62e36-7b54-4959-81eb-0ab28a14a060-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:32:39.857313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-57185083-bbce-4508-bd2b-9fd93a645448 tempest-VolumesTransfersTest-1508694960 None] Lock "b'cinder-3e2080d8-56fd-43ff-a909-f621b9fd5444-delete_volume'" released by "delete_volume" :: held 18.550s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:32:39.880848 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:40.767856 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:32:40.768465 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] Volume volume-0ad62e36-7b54-4959-81eb-0ab28a14a060 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:32:41.922681 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] deleting rbd volume volume-0ad62e36-7b54-4959-81eb-0ab28a14a060 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:32:42.000769 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:32:42.004780 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:32:42.004908 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:32:42.025474 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Flow 'volume_create_manager' (300223dd-baf8-4e60-a730-1d19e07099e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:32:42.033124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ff864f-eb14-43a0-be55-1296648fb9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:42.039386 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:32:42.053345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ff864f-eb14-43a0-be55-1296648fb9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-926821619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=297a6f21-2bf9-4267-bb44-3ea7080b20ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdac3100e374c09bbb793c83e7fd52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:32:41Z,use_quota=True,user_id='194ff6deb33c4798a71a7218d83bf74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:42.058834 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207e0881-af6f-4715-b0bb-08a28346cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:42.063236 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207e0881-af6f-4715-b0bb-08a28346cc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:42.068581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568e0e6c-e4ad-4ccf-9868-527c9a89cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:42.072783 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568e0e6c-e4ad-4ccf-9868-527c9a89cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297a6f21-2bf9-4267-bb44-3ea7080b20ee', 'volume_name': 'volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:42.078380 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965cd799-f96e-47f8-b099-b4f2aae73402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:42.082409 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965cd799-f96e-47f8-b099-b4f2aae73402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:42.087386 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88b0344-4cbf-4dc7-bd8b-0ade7ac3b990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:42.088459 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Volume 297a6f21-2bf9-4267-bb44-3ea7080b20ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee', 'volume_size': 1} Feb 12 21:32:42.088885 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] creating volume 'volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:32:42.089934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:44.261387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:32:44.262088 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:32:44.265553 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88b0344-4cbf-4dc7-bd8b-0ade7ac3b990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:44.270968 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0700105-3b58-4475-891b-4de2c5a64f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:32:44.492100 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Volume volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee (297a6f21-2bf9-4267-bb44-3ea7080b20ee): created successfully Feb 12 21:32:44.495996 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0700105-3b58-4475-891b-4de2c5a64f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:32:44.501784 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Flow 'volume_create_manager' (300223dd-baf8-4e60-a730-1d19e07099e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:32:44.577067 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7b9f730f-e8ec-4bd8-b68f-520099511f8e tempest-VolumesTransfersTest-1979150386 None] Created volume successfully. Feb 12 21:32:45.862729 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] Lock "b'cinder-297a6f21-2bf9-4267-bb44-3ea7080b20ee-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:32:45.953614 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:32:46.575711 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:32:46.576142 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] Volume volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:32:47.159518 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] deleting rbd volume volume-297a6f21-2bf9-4267-bb44-3ea7080b20ee {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:32:53.263271 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f1a9032f-f2b8-4a65-a253-551fc0eaceb1 tempest-SnapshotsActionsTest-1992154030 None] Created reservations ['995eaa69-7148-4302-8489-c3d915341608', 'b4ed683f-84c7-4147-a72a-236274c2ca06', '0fbc7865-ca9b-4a02-88d2-20b3a993c926', '079c5a5b-e0d9-4f04-9120-acb94afab7a8'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:32:53.456452 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f1a9032f-f2b8-4a65-a253-551fc0eaceb1 tempest-SnapshotsActionsTest-1992154030 None] Delete snapshot completed successfully. Feb 12 21:32:53.461476 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f1a9032f-f2b8-4a65-a253-551fc0eaceb1 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-08da7df1-ad40-4a1a-9080-d25152c8f9da-delete_snapshot'" released by "delete_snapshot" :: held 28.728s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:32:54.200579 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-017505fa-5ecc-4901-8ee7-152ecabf344c tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:01.434454 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] Created reservations ['246e9e0b-cff4-48f4-83a1-f8de2f1c54fe', '3e9e0194-e637-4007-804d-ec7f165b9d45', '05230540-bea3-45a5-823b-f75606a1b5a6', 'dceabdc1-80be-4fd1-ab30-9c4584766383'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:33:01.570924 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-017505fa-5ecc-4901-8ee7-152ecabf344c tempest-SnapshotsActionsTest-960797822 None] Create snapshot completed successfully Feb 12 21:33:01.622375 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:01.645726 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:01.670847 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:33:01.688265 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] Deleted volume successfully. Feb 12 21:33:01.878115 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-155928f9-0109-4289-a5a1-6c1003e3b977 tempest-VolumesGetTest-1942455120 None] Lock "b'cinder-0ad62e36-7b54-4959-81eb-0ab28a14a060-delete_volume'" released by "delete_volume" :: held 22.132s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:33:02.527452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d9e3ac41-ac3f-4abd-994d-f30caa83c222 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-da3714c6-546c-4f6f-8270-61be52d5c073-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:33:02.527452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d9e3ac41-ac3f-4abd-994d-f30caa83c222 tempest-SnapshotsActionsTest-1992154030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:05.332277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:33:05.335655 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:33:05.336099 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:33:05.355874 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Flow 'volume_create_manager' (e4a02aaa-cbb5-456c-9b6c-064270044f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:05.363222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2595701-b3a4-41d5-ac46-09b84b53cc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:05.369882 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:33:05.384468 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2595701-b3a4-41d5-ac46-09b84b53cc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-874129730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b8bea388-3a1e-4126-8e1c-7dfd4490d27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753fef9387244d0d98dccfd7cf8ca9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:33:05Z,use_quota=True,user_id='ad5f8388ce794f75bcb468047ef2393c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:05.390076 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1bc1bb-f0d7-4279-8256-c339c26413c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:05.394369 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1bc1bb-f0d7-4279-8256-c339c26413c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:05.399916 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c74648-c046-4006-8c87-47e8d20d0ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:05.404912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c74648-c046-4006-8c87-47e8d20d0ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bea388-3a1e-4126-8e1c-7dfd4490d27e', 'volume_name': 'volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:05.410816 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfc4d53-a656-4238-b233-72e31c758b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:05.414999 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfc4d53-a656-4238-b233-72e31c758b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:05.419924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894eeda7-a922-4772-84c3-31ae57f315ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:05.421692 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Volume b8bea388-3a1e-4126-8e1c-7dfd4490d27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e', 'volume_size': 1} Feb 12 21:33:05.422099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] creating volume 'volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:33:05.423147 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:06.974924 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:33:06.975564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:33:06.979264 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894eeda7-a922-4772-84c3-31ae57f315ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:06.984076 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036527db-7afe-47eb-b4bc-1bc427512abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:07.067192 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Volume volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e (b8bea388-3a1e-4126-8e1c-7dfd4490d27e): created successfully Feb 12 21:33:07.071179 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036527db-7afe-47eb-b4bc-1bc427512abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:07.078119 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Flow 'volume_create_manager' (e4a02aaa-cbb5-456c-9b6c-064270044f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:07.170400 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6697e271-27c2-4135-a2b6-448427878eef tempest-VolumesNegativeTest-910208263 None] Created volume successfully. Feb 12 21:33:07.551270 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] Created reservations ['ae1fef86-63e5-4d8b-8a0a-59e199f5dec6', 'a90c855e-bf14-4de5-852f-e3cc6c4922e0', '9362e737-51b1-4c8e-82fa-2ea6f9d39438', 'f7fb6d27-f23f-4b81-84e2-0838edc7cb08'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:33:07.794239 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:07.865576 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:07.910387 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:33:07.915278 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] Deleted volume successfully. Feb 12 21:33:07.998064 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a0571002-34e7-4402-91fa-4807fb833638 tempest-VolumesTransfersTest-1508694960 None] Lock "b'cinder-297a6f21-2bf9-4267-bb44-3ea7080b20ee-delete_volume'" released by "delete_volume" :: held 22.135s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:33:11.528267 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d9e3ac41-ac3f-4abd-994d-f30caa83c222 tempest-SnapshotsActionsTest-1992154030 None] Created reservations ['ce16ab83-2f9c-486c-84c7-8e1c7d2cae40', 'f052a14d-9207-4070-842f-9d844420dd89', 'b8026fdf-5625-4af3-ba91-6957afae0438', '16a525dd-21ff-4d64-b846-91d59428dc67'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:33:11.664445 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:33:11.665461 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:11.696432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:11.735348 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:33:11.737809 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d9e3ac41-ac3f-4abd-994d-f30caa83c222 tempest-SnapshotsActionsTest-1992154030 None] Delete snapshot completed successfully. Feb 12 21:33:11.743659 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d9e3ac41-ac3f-4abd-994d-f30caa83c222 tempest-SnapshotsActionsTest-1992154030 None] Lock "b'cinder-da3714c6-546c-4f6f-8270-61be52d5c073-delete_snapshot'" released by "delete_snapshot" :: held 9.218s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:33:12.659637 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-ff9e72cd-e654-4889-9978-5218a5736e37 tempest-SnapshotsActionsTest-960797822 None] Lock "b'cinder-87cc87a8-6d52-435a-a7e6-ea44796f9a80-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:33:12.662078 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-ff9e72cd-e654-4889-9978-5218a5736e37 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:14.600937 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] Terminate volume connection completed successfully. Feb 12 21:33:14.619036 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-21a70fde-e83b-434f-aad7-58124853c1fc tempest-VolumesBackupsTest-835000994 None] Remove volume export completed successfully. Feb 12 21:33:16.355154 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:33:16.360393 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:33:16.361760 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:33:16.385548 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Flow 'volume_create_manager' (b71f3b6b-cabd-44d3-8690-317e9600c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:16.392876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7f2960-75e4-4437-81de-777661ae5608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:16.405913 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:33:16.429756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7f2960-75e4-4437-81de-777661ae5608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:33:16Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_91a00afe-73f8-4fb5-b868-f5cd70a56fc7',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3445accb-08f9-4e70-b9c5-49b4639a3aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb7edbcd0864f13be6f5138d1350e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:33:16Z,use_quota=True,user_id='d083b81672cd463fb6cce6f8a602bb4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:16.431285 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e95bea-57df-4f25-a992-2e45fc6464a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:16.436014 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e95bea-57df-4f25-a992-2e45fc6464a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:16.447368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb19fa6-444a-4929-9c41-f2c98cd8cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:16.454541 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb19fa6-444a-4929-9c41-f2c98cd8cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3445accb-08f9-4e70-b9c5-49b4639a3aa1', 'volume_name': 'volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:16.461755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db813ca6-9eb7-47a9-8ee0-4e0c277ce5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:16.465955 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db813ca6-9eb7-47a9-8ee0-4e0c277ce5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:16.471103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21daf9-6e18-4e82-b6e6-a03f1d3625f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:16.472415 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Volume 3445accb-08f9-4e70-b9c5-49b4639a3aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1', 'volume_size': 1} Feb 12 21:33:16.472802 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] creating volume 'volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:33:16.473847 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:17.205770 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-ff9e72cd-e654-4889-9978-5218a5736e37 tempest-SnapshotsActionsTest-960797822 None] Created reservations ['34d6289a-17bf-40fc-b3c7-581e4c9d2c48', 'ee0c84b7-c748-48c3-8662-a0ddc9671020', '89bcb257-221d-48db-8fdf-64c9b8d7756e', '8364a9c0-8091-46f5-9ae0-2e1bacdc1c6a'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:33:17.367247 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-ff9e72cd-e654-4889-9978-5218a5736e37 tempest-SnapshotsActionsTest-960797822 None] Delete snapshot completed successfully. Feb 12 21:33:17.379300 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-ff9e72cd-e654-4889-9978-5218a5736e37 tempest-SnapshotsActionsTest-960797822 None] Lock "b'cinder-87cc87a8-6d52-435a-a7e6-ea44796f9a80-delete_snapshot'" released by "delete_snapshot" :: held 4.715s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:33:17.969643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:33:17.970036 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:33:17.975077 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21daf9-6e18-4e82-b6e6-a03f1d3625f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:17.980151 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab5745f-5c27-422a-aa82-809e73dff4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:18.058403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] Lock "b'cinder-55a30bb7-cacf-40b7-b848-bf47e3ab120b-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:33:18.061911 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Volume volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1 (3445accb-08f9-4e70-b9c5-49b4639a3aa1): created successfully Feb 12 21:33:18.073202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab5745f-5c27-422a-aa82-809e73dff4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:18.090251 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Flow 'volume_create_manager' (b71f3b6b-cabd-44d3-8690-317e9600c80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:18.209284 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Created volume successfully. Feb 12 21:33:18.229742 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:18.617171 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:33:18.620934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] Volume volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:33:18.869222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] deleting rbd volume volume-55a30bb7-cacf-40b7-b848-bf47e3ab120b {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:33:19.525790 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:33:20.419909 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:33:20.420709 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '3445accb-08f9-4e70-b9c5-49b4639a3aa1', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:33:20.437501 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Initialize volume connection completed successfully. Feb 12 21:33:26.572710 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] Terminate volume connection completed successfully. Feb 12 21:33:26.599499 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9d1c8fa6-3edb-4a62-b71e-9621cf52e64d tempest-TestVolumeBackupRestore-1020972158 None] Remove volume export completed successfully. Feb 12 21:33:28.405041 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] Created reservations ['5e7da749-78c0-4d90-8594-b1c08be82cd6', '513b8b35-9cca-4f70-9f10-bdbc73c03a68', '08efaca6-2b3b-47d5-b779-d8f4566f1220', '9813c996-5547-4ecc-b1d0-01593b565c40'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:33:28.729710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:28.752478 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:28.790788 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:33:28.795741 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:33:28.799819 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:33:28.800336 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:33:28.821059 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Flow 'volume_create_manager' (08ec2afd-594d-4d4e-87b4-b7c052c6581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:28.828136 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da257e5-29a3-4e78-a3ea-b45fdf99b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:28.837327 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] Deleted volume successfully. Feb 12 21:33:28.838124 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:33:28.860565 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da257e5-29a3-4e78-a3ea-b45fdf99b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:33:28Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_278e59a9-78b0-48d1-ab85-d144c12c2de5',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=29b7e6aa-158b-4248-a1b3-80e64eeff62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfcb9d238a52483a94553e900468a87c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:33:29Z,use_quota=True,user_id='dd1a01a1f86a4f4ca3997db04ed1b4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:28.867103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d34022b-606a-4cdb-bbd2-36dc2f2ebedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:28.871465 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d34022b-606a-4cdb-bbd2-36dc2f2ebedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:28.880825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc29628-4991-4836-9cc6-ebc2ce1f2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:28.882651 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc29628-4991-4836-9cc6-ebc2ce1f2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'volume_name': 'volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:28.887628 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e4d49c-6e9f-4165-aeee-90b1e3034c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:28.903259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e4d49c-6e9f-4165-aeee-90b1e3034c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:28.908723 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb64060a-b134-447f-99f0-84c9dc540290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:28.909994 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Volume 29b7e6aa-158b-4248-a1b3-80e64eeff62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'volume_size': 1} Feb 12 21:33:28.910450 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] creating volume 'volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:33:28.911657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:28.955772 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-aed01596-984d-4b0a-882b-6c21f997cdd6 tempest-SnapshotsActionsTest-960797822 None] Lock "b'cinder-55a30bb7-cacf-40b7-b848-bf47e3ab120b-delete_volume'" released by "delete_volume" :: held 10.897s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:33:29.384567 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] Lock "b'cinder-b8bea388-3a1e-4126-8e1c-7dfd4490d27e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:33:29.494455 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:30.094561 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:33:30.103878 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] Volume volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:33:30.400990 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] deleting rbd volume volume-b8bea388-3a1e-4126-8e1c-7dfd4490d27e {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:33:30.414605 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:33:30.414991 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:33:30.419242 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb64060a-b134-447f-99f0-84c9dc540290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:30.424322 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e51e9e-4034-4982-92cc-9dd6ed96ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:30.512880 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Volume volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a (29b7e6aa-158b-4248-a1b3-80e64eeff62a): created successfully Feb 12 21:33:30.516643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e51e9e-4034-4982-92cc-9dd6ed96ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:30.523157 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Flow 'volume_create_manager' (08ec2afd-594d-4d4e-87b4-b7c052c6581f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:30.620946 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Created volume successfully. Feb 12 21:33:31.962355 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:33:32.975284 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.012s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:33:32.976555 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:33:33.010523 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Initialize volume connection completed successfully. Feb 12 21:33:41.578103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:33:41.582525 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:33:41.587775 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:33:41.604495 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Flow 'volume_create_manager' (d52c691e-6bc5-4d5c-814c-bdcfc1a4b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:41.611492 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0751d399-d216-45e7-a88a-80918a9c33b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:41.620853 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:33:41.635523 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0751d399-d216-45e7-a88a-80918a9c33b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-741009826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a0daa52e-7dba-4527-9c5a-cc39ae607708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6c242b7ff346f5b5cb6b75c4321618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:33:41Z,use_quota=True,user_id='c5e0e7a6b76b4cfeb2c032cfff336d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:41.641933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d327e5a4-bd51-4043-8284-006ee5d67c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:41.645827 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d327e5a4-bd51-4043-8284-006ee5d67c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:41.652288 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c38f62-9d73-4ba3-831b-8dc7a8e23358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:41.656661 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c38f62-9d73-4ba3-831b-8dc7a8e23358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0daa52e-7dba-4527-9c5a-cc39ae607708', 'volume_name': 'volume-a0daa52e-7dba-4527-9c5a-cc39ae607708', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:41.661780 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062c5122-dc36-41f3-b5c6-267e0289306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:41.666751 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062c5122-dc36-41f3-b5c6-267e0289306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:41.671755 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f750c44-5f8c-4216-a3a7-7b5d968ead87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:41.672732 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Volume a0daa52e-7dba-4527-9c5a-cc39ae607708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0daa52e-7dba-4527-9c5a-cc39ae607708', 'volume_size': 1} Feb 12 21:33:41.673137 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] creating volume 'volume-a0daa52e-7dba-4527-9c5a-cc39ae607708' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:33:41.677257 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:47.124509 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:33:47.125180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:33:47.128740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f750c44-5f8c-4216-a3a7-7b5d968ead87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0daa52e-7dba-4527-9c5a-cc39ae607708', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:47.134756 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92576e09-bd7c-4423-86cd-f0fc81d5e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:33:47.221886 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Volume volume-a0daa52e-7dba-4527-9c5a-cc39ae607708 (a0daa52e-7dba-4527-9c5a-cc39ae607708): created successfully Feb 12 21:33:47.229819 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92576e09-bd7c-4423-86cd-f0fc81d5e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:33:47.236253 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Flow 'volume_create_manager' (d52c691e-6bc5-4d5c-814c-bdcfc1a4b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:33:47.354001 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-0b82fe49-d5e4-4a33-acd8-551dab529275 tempest-VolumesBackupsAdminTest-354663248 None] Created volume successfully. Feb 12 21:33:48.348190 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:33:47Z,data_timestamp=2022-02-12T21:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-368492704',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=0ee17d6a-58ae-4bdd-9100-172dbd9af093,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4d6c242b7ff346f5b5cb6b75c4321618',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c5e0e7a6b76b4cfeb2c032cfff336d9e',volume_id=a0daa52e-7dba-4527-9c5a-cc39ae607708) Feb 12 21:33:48.349048 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] continue_backup in rpcapi backup_id 0ee17d6a-58ae-4bdd-9100-172dbd9af093 {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:33:48.524210 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:33:49.268322 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.744s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:33:49.270070 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a0daa52e-7dba-4527-9c5a-cc39ae607708', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'a0daa52e-7dba-4527-9c5a-cc39ae607708', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:33:49.292812 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] Initialize volume connection completed successfully. Feb 12 21:33:50.012498 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] Created reservations ['512d4e6d-f202-4354-a4f2-75fc3ea21ee1', '22764dc4-009c-41b0-bac3-38bcdd4113ba', '64a6abd8-3519-41d0-ab33-5662bf29bf0c', 'd6c2acc5-7496-4c1b-bc89-dfc15cdbba48'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:33:50.321275 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:50.389594 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:50.439610 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:33:50.455162 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] Deleted volume successfully. Feb 12 21:33:50.560180 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1a84c538-0620-46af-b45f-5b34bc2da8f3 tempest-VolumesNegativeTest-910208263 None] Lock "b'cinder-b8bea388-3a1e-4126-8e1c-7dfd4490d27e-delete_volume'" released by "delete_volume" :: held 21.176s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:33:53.192721 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 req-752ead30-9592-4387-8e2e-8f940d61f074 tempest-TestVolumeBootPattern-1530501963 None] Terminate volume connection completed successfully. Feb 12 21:33:53.193510 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 req-752ead30-9592-4387-8e2e-8f940d61f074 tempest-TestVolumeBootPattern-1530501963 None] Deleting attachment 45768f45-8afb-4bda-84d3-91a503040a0a. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:33:55.548794 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-246c1cd8-ec05-45ad-9455-c09c770c0c58-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:33:55.702374 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:33:56.999981 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:33:57.326600 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] deleting rbd volume volume-246c1cd8-ec05-45ad-9455-c09c770c0c58 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:34:11.662072 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:34:11.663722 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:11.715952 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:11.761506 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:34:15.626412 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] Terminate volume connection completed successfully. Feb 12 21:34:15.646621 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1443d1c9-24da-4515-8de6-33614bf22a14 tempest-VolumesBackupsAdminTest-354663248 None] Remove volume export completed successfully. Feb 12 21:34:18.210853 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:34:19.781998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] deleting parent snapshot volume-246c1cd8-ec05-45ad-9455-c09c770c0c58.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:34:28.311432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] Created reservations ['b14b49bd-ee8f-4b23-a62f-56c216826940', '335c91bb-14ce-4e63-8aef-de4c0f67dea8', '567e40da-93c2-4ab1-9a4f-6c271c4473a1', 'c16105b5-dd39-45ce-b74a-219fb91d89c8'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:34:28.355902 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:34:28.359937 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:34:28.360522 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:34:28.380465 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Flow 'volume_create_manager' (402c0153-6997-4ca1-87d9-c649e70991d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:34:28.387752 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5088dc6-d1b4-4540-95f2-cb3466e2332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:28.395205 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:34:28.410410 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5088dc6-d1b4-4540-95f2-cb3466e2332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:34:18Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_0ee17d6a-58ae-4bdd-9100-172dbd9af093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=542debdc-b1de-48aa-8a7e-2e6fbb4522d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6c242b7ff346f5b5cb6b75c4321618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:34:18Z,use_quota=True,user_id='c5e0e7a6b76b4cfeb2c032cfff336d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:28.416949 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2162dd5-ca22-49c7-bf0c-767130eb2847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:28.421343 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2162dd5-ca22-49c7-bf0c-767130eb2847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:28.426839 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183e43e9-bb50-41e2-850f-3fab224e5d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:28.431875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183e43e9-bb50-41e2-850f-3fab224e5d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542debdc-b1de-48aa-8a7e-2e6fbb4522d7', 'volume_name': 'volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:28.437248 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd838cec-bdf0-4bd3-9f62-8e60e5c3b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:28.442031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd838cec-bdf0-4bd3-9f62-8e60e5c3b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:28.447484 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef08f358-adb5-4198-abf6-44de1f08a30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:28.448800 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Volume 542debdc-b1de-48aa-8a7e-2e6fbb4522d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7', 'volume_size': 1} Feb 12 21:34:28.449234 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] creating volume 'volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:34:28.450361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:28.646266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:28.684008 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:28.723483 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:34:28.728229 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] Deleted volume successfully. Feb 12 21:34:28.832000 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d5c2eb65-5506-4dac-8c13-3f2d2da9e989 tempest-TestVolumeBootPattern-1530501963 None] Lock "b'cinder-246c1cd8-ec05-45ad-9455-c09c770c0c58-delete_volume'" released by "delete_volume" :: held 33.283s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:34:29.794822 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:34:29.795477 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:34:29.799785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef08f358-adb5-4198-abf6-44de1f08a30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:29.805034 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad64c0ce-09f7-41a4-8019-f05cf4005a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:29.904406 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Volume volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7 (542debdc-b1de-48aa-8a7e-2e6fbb4522d7): created successfully Feb 12 21:34:29.914656 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad64c0ce-09f7-41a4-8019-f05cf4005a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:29.931950 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Flow 'volume_create_manager' (402c0153-6997-4ca1-87d9-c649e70991d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:34:30.004980 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Created volume successfully. Feb 12 21:34:30.974208 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:34:31.749564 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.775s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:34:31.750372 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '542debdc-b1de-48aa-8a7e-2e6fbb4522d7', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:34:31.767141 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Initialize volume connection completed successfully. Feb 12 21:34:34.245095 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Terminate volume connection completed successfully. Feb 12 21:34:34.266598 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8d82f7fb-8533-4d5e-bc9f-ef092143d1fb tempest-VolumesBackupsTest-835000994 None] Remove volume export completed successfully. Feb 12 21:34:35.105979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-3445accb-08f9-4e70-b9c5-49b4639a3aa1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:34:35.227055 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:37.723531 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] Volume volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:34:38.636000 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] deleting rbd volume volume-3445accb-08f9-4e70-b9c5-49b4639a3aa1 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:34:38.715058 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Terminate volume connection completed successfully. Feb 12 21:34:38.764764 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-04f84363-5457-4805-b757-95d34a52e2c6 tempest-VolumesBackupsAdminTest-354663248 None] Remove volume export completed successfully. Feb 12 21:34:40.936859 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] Lock "b'cinder-542debdc-b1de-48aa-8a7e-2e6fbb4522d7-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:34:41.143875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:43.589645 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] Volume volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:34:44.511469 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] deleting rbd volume volume-542debdc-b1de-48aa-8a7e-2e6fbb4522d7 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:34:44.531594 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Terminate volume connection completed successfully. Feb 12 21:34:44.570346 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2b5487ba-cbd0-4931-b501-3893a3ad874e tempest-TestVolumeBackupRestore-1020972158 None] Remove volume export completed successfully. Feb 12 21:34:48.966064 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] Created reservations ['cd2f9155-a70d-4972-b2a3-8ca1044192c6', 'aaf09266-db90-42cf-9fd2-074fba10aab9', 'ec2a93fc-4c78-4676-a736-c85d596672c4', '278a679e-9528-4293-8745-b8532e2fcd96'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:34:49.228217 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:49.266141 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:49.318892 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:34:49.323716 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] Deleted volume successfully. Feb 12 21:34:49.414602 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2681aff3-9edc-4bd8-8364-d22a54259952 tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-3445accb-08f9-4e70-b9c5-49b4639a3aa1-delete_volume'" released by "delete_volume" :: held 14.309s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:34:51.686302 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] Created reservations ['4382e8ae-2877-44dd-bd6c-3c14fa9cd008', 'f60165c7-832b-4db5-b291-46169c80c07d', '719b9e7d-ef58-4ca6-96f1-8973054e4d99', 'fb13a330-b32f-4bf8-bb71-d98a1ebc48fa'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:34:51.942994 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:52.012198 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:52.048188 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:34:52.052715 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] Deleted volume successfully. Feb 12 21:34:52.127830 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e290cb63-ef25-44ad-8734-d013eba18131 tempest-VolumesBackupsAdminTest-354663248 None] Lock "b'cinder-542debdc-b1de-48aa-8a7e-2e6fbb4522d7-delete_volume'" released by "delete_volume" :: held 11.187s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:34:54.182994 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-ddceb450-f7cc-4ec8-b806-9417e7f7118c req-bb14e490-07ee-4193-a0e5-fed47c303056 tempest-TestVolumeBackupRestore-1020972158 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:34:54.890850 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-ddceb450-f7cc-4ec8-b806-9417e7f7118c req-bb14e490-07ee-4193-a0e5-fed47c303056 tempest-TestVolumeBackupRestore-1020972158 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.707s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:34:54.891682 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-ddceb450-f7cc-4ec8-b806-9417e7f7118c req-bb14e490-07ee-4193-a0e5-fed47c303056 tempest-TestVolumeBackupRestore-1020972158 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:34:55.027783 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-ddceb450-f7cc-4ec8-b806-9417e7f7118c req-bb14e490-07ee-4193-a0e5-fed47c303056 tempest-TestVolumeBackupRestore-1020972158 None] Connection info returned from driver {'name': 'volumes/volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '29b7e6aa-158b-4248-a1b3-80e64eeff62a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd831ee04-1e4e-4809-9413-91a6cdc2f1e0'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:34:55.193707 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-ddceb450-f7cc-4ec8-b806-9417e7f7118c req-bb14e490-07ee-4193-a0e5-fed47c303056 tempest-TestVolumeBackupRestore-1020972158 None] attachment_update completed successfully. Feb 12 21:34:55.862419 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:34:55.871632 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:34:55.875130 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:34:55.904210 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Flow 'volume_create_manager' (3581c18b-32ec-4505-9e09-0df6a9826aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:34:55.912602 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c87bfa-b37a-4fe3-bbba-60fae7354ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:55.924916 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:34:55.943657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c87bfa-b37a-4fe3-bbba-60fae7354ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-330397169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e67ac3c6-5802-4c5c-88c9-0ee335dfea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6c242b7ff346f5b5cb6b75c4321618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:34:56Z,use_quota=True,user_id='c5e0e7a6b76b4cfeb2c032cfff336d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:55.950489 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b103f64b-c4cf-4f24-ab07-08fcce8c1c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:55.954904 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b103f64b-c4cf-4f24-ab07-08fcce8c1c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:55.960392 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c077c4e5-075e-47b6-a9f0-42374d819e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:55.965176 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c077c4e5-075e-47b6-a9f0-42374d819e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67ac3c6-5802-4c5c-88c9-0ee335dfea0a', 'volume_name': 'volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:55.970366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0020edc2-0e43-41db-89c4-00af36ca8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:55.975171 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0020edc2-0e43-41db-89c4-00af36ca8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:55.980032 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf23a6ac-f4a8-4d7e-bcb1-677fd6111cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:55.981571 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Volume e67ac3c6-5802-4c5c-88c9-0ee335dfea0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a', 'volume_size': 1} Feb 12 21:34:55.982108 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] creating volume 'volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:34:55.983096 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:34:56.999788 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:34:57.000462 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:34:57.005088 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf23a6ac-f4a8-4d7e-bcb1-677fd6111cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:57.010143 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769dc5b8-e328-4b07-8718-279b9cb9c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:34:57.112624 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Volume volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a (e67ac3c6-5802-4c5c-88c9-0ee335dfea0a): created successfully Feb 12 21:34:57.116515 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769dc5b8-e328-4b07-8718-279b9cb9c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:34:57.122817 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Flow 'volume_create_manager' (3581c18b-32ec-4505-9e09-0df6a9826aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:34:57.217462 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-745d2e17-7881-46ce-b1be-841f152fe6ad tempest-VolumesBackupsAdminTest-354663248 None] Created volume successfully. Feb 12 21:34:58.399338 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-02-12T21:34:57Z,data_timestamp=2022-02-12T21:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-2075372544',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=8622758b-1127-4f0b-a744-f68cf8a82b4a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4d6c242b7ff346f5b5cb6b75c4321618',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c5e0e7a6b76b4cfeb2c032cfff336d9e',volume_id=e67ac3c6-5802-4c5c-88c9-0ee335dfea0a) Feb 12 21:34:58.400034 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.backup.rpcapi [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] continue_backup in rpcapi backup_id 8622758b-1127-4f0b-a744-f68cf8a82b4a {{(pid=134690) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Feb 12 21:34:58.515301 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:34:59.186179 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.671s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:34:59.187240 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'e67ac3c6-5802-4c5c-88c9-0ee335dfea0a', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:34:59.200224 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] Initialize volume connection completed successfully. Feb 12 21:35:03.943410 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-8634339a-63d4-437c-aab7-c9cd3446b531-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:04.041509 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:07.440767 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] deleting rbd volume volume-8634339a-63d4-437c-aab7-c9cd3446b531 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:35:07.476302 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] Terminate volume connection completed successfully. Feb 12 21:35:07.494963 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-aef30e0b-add6-486f-b07b-7fa45c3574af tempest-VolumesBackupsAdminTest-354663248 None] Remove volume export completed successfully. Feb 12 21:35:11.660155 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:35:11.661009 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:11.682826 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:11.710121 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:35:11.731893 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:35:11.869222 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] deleting parent snapshot volume-8634339a-63d4-437c-aab7-c9cd3446b531.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:35:15.022453 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] Created reservations ['0f057882-c5c9-4a2d-a968-eeba210bccd6', '24b71d2e-540c-449e-8aa8-b3d406670f7c', '3bc041e4-7611-4b7f-86a0-54cf0437467d', 'e2de90fa-85e9-4c92-b125-39aa089638b6'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:35:15.188594 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:15.364934 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:15.389274 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:35:15.395815 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] Deleted volume successfully. Feb 12 21:35:15.466381 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f093ec23-02e6-4cbf-93de-ce7015a354af tempest-VolumesBackupsTest-835000994 None] Lock "b'cinder-8634339a-63d4-437c-aab7-c9cd3446b531-delete_volume'" released by "delete_volume" :: held 11.524s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:18.240174 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] Lock "b'cinder-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:18.315413 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:35:18.319168 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:35:18.319652 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:35:18.340619 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Flow 'volume_create_manager' (e6ce0387-be23-4a5d-ab79-e3e93a9dc2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:35:18.347487 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9a0eb5-43fa-41c7-a62a-14dc5f43bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:18.356893 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:35:18.376639 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9a0eb5-43fa-41c7-a62a-14dc5f43bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1188780710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3cf35c3d-a1f0-4712-ab3f-030663dbd33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f503d29636ee432691c513337f506a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:35:18Z,use_quota=True,user_id='6c2f3226f72643d3baaa89507916f5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:18.382218 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0ba977-c707-4729-bf19-9932627355fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:18.386451 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0ba977-c707-4729-bf19-9932627355fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:18.391740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bdea03-34d1-41c0-936f-971bbe1c70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:18.396581 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bdea03-34d1-41c0-936f-971bbe1c70a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf35c3d-a1f0-4712-ab3f-030663dbd33f', 'volume_name': 'volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:18.401661 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f544182b-ac33-4751-b19b-a2625f5392de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:18.406233 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f544182b-ac33-4751-b19b-a2625f5392de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:18.412046 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abddf6b4-d6d8-4fb3-bc7b-a75b782343ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:18.413136 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Volume 3cf35c3d-a1f0-4712-ab3f-030663dbd33f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f', 'volume_size': 1} Feb 12 21:35:18.413561 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] creating volume 'volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:35:18.414522 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:18.441914 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:19.808930 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] Volume volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:35:20.328236 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] deleting rbd volume volume-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:35:20.332609 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:35:20.332992 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:35:20.336998 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abddf6b4-d6d8-4fb3-bc7b-a75b782343ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:20.341921 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edd50a2-2ef2-48f6-88d7-3a915d0e6c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:20.450521 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Volume volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f (3cf35c3d-a1f0-4712-ab3f-030663dbd33f): created successfully Feb 12 21:35:20.454304 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edd50a2-2ef2-48f6-88d7-3a915d0e6c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:20.460405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Flow 'volume_create_manager' (e6ce0387-be23-4a5d-ab79-e3e93a9dc2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:35:20.553627 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5b4e737a-e30f-4a55-982f-03cc310187a6 tempest-VolumesSnapshotListTestJSON-3976893 None] Created volume successfully. Feb 12 21:35:21.895737 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e692623d-a7e8-4d35-940e-d177c3fa617a tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:25.296535 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e692623d-a7e8-4d35-940e-d177c3fa617a tempest-VolumesSnapshotListTestJSON-3976893 None] Create snapshot completed successfully Feb 12 21:35:25.706725 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] Created reservations ['af8123de-fe17-40c5-b248-b1e0e1ca8085', 'a5db715c-d519-4db3-8943-1d07a21f6260', 'aaec2ef7-8979-4156-b5d4-f6a947dd0782', '633b8bef-6423-4392-834a-9220b90de979'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:35:25.932241 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:25.956005 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:25.979245 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:35:25.983601 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] Deleted volume successfully. Feb 12 21:35:26.087454 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-08532c9a-9dc6-4e48-a513-03eb3cedb1af tempest-VolumesBackupsAdminTest-354663248 None] Lock "b'cinder-e67ac3c6-5802-4c5c-88c9-0ee335dfea0a-delete_volume'" released by "delete_volume" :: held 7.847s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:26.422342 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c59eae94-ab4c-42b5-89cb-b47dadd2f3e3 tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:26.834711 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] Lock "b'cinder-a0daa52e-7dba-4527-9c5a-cc39ae607708-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:26.934204 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:29.632625 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] Volume volume-a0daa52e-7dba-4527-9c5a-cc39ae607708 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:35:30.411444 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] deleting rbd volume volume-a0daa52e-7dba-4527-9c5a-cc39ae607708 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:35:31.422436 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c59eae94-ab4c-42b5-89cb-b47dadd2f3e3 tempest-VolumesSnapshotListTestJSON-3976893 None] Create snapshot completed successfully Feb 12 21:35:32.941964 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-7081f383-2050-4b62-8f49-b414db1c333d tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:36.444963 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-7081f383-2050-4b62-8f49-b414db1c333d tempest-VolumesSnapshotListTestJSON-3976893 None] Create snapshot completed successfully Feb 12 21:35:37.758505 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2250989b-42d0-40ae-af41-b37a18a5e92f tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-8060bd5b-2f36-4aa9-ab65-7210ed521b70-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:37.758505 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2250989b-42d0-40ae-af41-b37a18a5e92f tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:37.938468 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] Created reservations ['073889bb-5f77-4cb5-843c-70aba57d8f65', 'f47e85ab-a5df-4e86-9247-4f70742cb241', '2c143acf-4627-4889-a111-13c84aa4e11f', '89da3b20-d8cb-4867-9611-177d250747b0'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:35:38.220751 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:38.249931 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:38.279209 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:35:38.284172 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] Deleted volume successfully. Feb 12 21:35:38.371672 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f8e5737e-928e-470f-926e-3ff6672dbea6 tempest-VolumesBackupsAdminTest-354663248 None] Lock "b'cinder-a0daa52e-7dba-4527-9c5a-cc39ae607708-delete_volume'" released by "delete_volume" :: held 11.534s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:42.508535 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-2250989b-42d0-40ae-af41-b37a18a5e92f tempest-VolumesSnapshotListTestJSON-3976893 None] Created reservations ['2cc78f3d-207d-49be-a3d7-c56cdbdec9a7', 'a023dbe7-2978-48ee-81d5-28787fa27854', '380a1e39-04f8-427e-92b3-94083e773167', 'f852cd83-40e2-40a7-8145-f256372c79c1'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:35:42.673720 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2250989b-42d0-40ae-af41-b37a18a5e92f tempest-VolumesSnapshotListTestJSON-3976893 None] Delete snapshot completed successfully. Feb 12 21:35:42.678506 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2250989b-42d0-40ae-af41-b37a18a5e92f tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-8060bd5b-2f36-4aa9-ab65-7210ed521b70-delete_snapshot'" released by "delete_snapshot" :: held 4.949s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:43.008355 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2f9febff-d5bd-4150-8dea-85ac98fcbcb6 tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-94df4c3e-3225-45db-b175-d8628c01ffe4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:43.010119 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2f9febff-d5bd-4150-8dea-85ac98fcbcb6 tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:43.250984 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:35:43.254979 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:35:43.255361 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:35:43.274626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Flow 'volume_create_manager' (52f74f4f-30e8-418b-86e7-99ca9f27355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:35:43.281713 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f75f822-494e-4f42-9e98-8c70b8896862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:43.289086 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:35:43.304388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f75f822-494e-4f42-9e98-8c70b8896862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-306348969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e124127c-5ac3-4842-bad0-5349300c177d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbfee23b6ad480da6dc4127fba1ca2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:35:43Z,use_quota=True,user_id='381f8fbc45dc421081092e9d964440a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:43.310062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8806f-f4fa-4815-ab53-3cd4de619fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:43.315197 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8806f-f4fa-4815-ab53-3cd4de619fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:43.320534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415af945-c9bf-4b31-af48-4ad6a5e02355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:43.408887 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415af945-c9bf-4b31-af48-4ad6a5e02355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e124127c-5ac3-4842-bad0-5349300c177d', 'volume_name': 'volume-e124127c-5ac3-4842-bad0-5349300c177d', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:43.414365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da27adbd-f877-4061-aa63-400e70702852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:43.418626 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da27adbd-f877-4061-aa63-400e70702852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:43.424052 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f72340-d104-4c90-bc24-c649a6909043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:43.425315 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Volume e124127c-5ac3-4842-bad0-5349300c177d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e124127c-5ac3-4842-bad0-5349300c177d', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:35:43.426049 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Cloning e124127c-5ac3-4842-bad0-5349300c177d from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:35:43.435252 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:43.512112 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 35, 43, 439513)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:35:43.512759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:35:43.512909 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:35:43.517767 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.083s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:43.518677 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:35:43.599444 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 35, 43, 522203)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:35:43.599939 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:35:43.600326 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:35:43.613915 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:43.799168 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] creating snapshot='volume-e124127c-5ac3-4842-bad0-5349300c177d.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:35:46.484259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-e124127c-5ac3-4842-bad0-5349300c177d.clone_snap' to 'volume-e124127c-5ac3-4842-bad0-5349300c177d' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:35:47.267286 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-2f9febff-d5bd-4150-8dea-85ac98fcbcb6 tempest-VolumesSnapshotListTestJSON-3976893 None] Created reservations ['fd53654b-bc80-481d-b9db-aa6b8e594187', '58af229b-0a7e-45cb-81fb-165f03b3141d', 'ef642eab-7a29-4d6e-b28d-934b09813eb2', 'eeadc1ba-12e4-4548-a229-f0f7e8eb83e2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:35:47.437472 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2f9febff-d5bd-4150-8dea-85ac98fcbcb6 tempest-VolumesSnapshotListTestJSON-3976893 None] Delete snapshot completed successfully. Feb 12 21:35:47.446841 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2f9febff-d5bd-4150-8dea-85ac98fcbcb6 tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-94df4c3e-3225-45db-b175-d8628c01ffe4-delete_snapshot'" released by "delete_snapshot" :: held 4.434s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:48.319170 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a1e6f807-2995-4970-94b7-6fc38c1ee3a0 tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-dc6864bd-7a74-4bdb-bb18-e4f133da3c1d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:48.320913 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-a1e6f807-2995-4970-94b7-6fc38c1ee3a0 tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:48.664352 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:35:48.665641 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:35:48.666018 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:35:49.229490 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:35:49.229490 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Marking volume e124127c-5ac3-4842-bad0-5349300c177d as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:35:49.314457 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to e124127c-5ac3-4842-bad0-5349300c177d. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:35:49.315144 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Creating volume glance metadata for volume e124127c-5ac3-4842-bad0-5349300c177d backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:35:49.430276 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f72340-d104-4c90-bc24-c649a6909043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e124127c-5ac3-4842-bad0-5349300c177d', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:49.435261 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4ced88-2649-4bf6-a6e0-8106b4b8315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:35:49.528976 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Volume volume-e124127c-5ac3-4842-bad0-5349300c177d (e124127c-5ac3-4842-bad0-5349300c177d): created successfully Feb 12 21:35:49.533834 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4ced88-2649-4bf6-a6e0-8106b4b8315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:35:49.539550 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Flow 'volume_create_manager' (52f74f4f-30e8-418b-86e7-99ca9f27355f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:35:49.614891 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-4e3d6fe0-ecaf-4d17-8ce3-69e46ce8c6ef tempest-VolumesImageMetadata-89090742 None] Created volume successfully. Feb 12 21:35:50.842663 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] Lock "b'cinder-e124127c-5ac3-4842-bad0-5349300c177d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:50.930817 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:51.370827 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:35:51.486499 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] deleting rbd volume volume-e124127c-5ac3-4842-bad0-5349300c177d {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:35:53.737297 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-a1e6f807-2995-4970-94b7-6fc38c1ee3a0 tempest-VolumesSnapshotListTestJSON-3976893 None] Created reservations ['3a2bbb12-5a68-4fd8-a4ba-fa995ccdd3ec', '5df875e4-a913-47d5-9830-8e5158a1341d', '63212da3-e079-4641-be6b-73f1c182d170', '3964936f-cb84-4782-8320-a2bf4fef5eb6'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:35:53.932268 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-a1e6f807-2995-4970-94b7-6fc38c1ee3a0 tempest-VolumesSnapshotListTestJSON-3976893 None] Delete snapshot completed successfully. Feb 12 21:35:53.937462 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-a1e6f807-2995-4970-94b7-6fc38c1ee3a0 tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-dc6864bd-7a74-4bdb-bb18-e4f133da3c1d-delete_snapshot'" released by "delete_snapshot" :: held 5.618s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:35:54.713317 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-3cf35c3d-a1f0-4712-ab3f-030663dbd33f-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:35:54.835539 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:35:55.114118 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:35:55.114540 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] Volume volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:35:55.332103 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] deleting rbd volume volume-3cf35c3d-a1f0-4712-ab3f-030663dbd33f {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:35:58.983603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:35:59.969131 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] deleting parent snapshot volume-e124127c-5ac3-4842-bad0-5349300c177d.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:36:04.091585 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] Created reservations ['7e0f8e86-da3a-44d3-9924-26f7edcecc15', 'ee521bb6-fee5-4a8a-96c7-5455b009022f', '69b81882-89e4-44a8-9b0d-88aaa8daab8e', '39f6c533-56f1-49d6-8989-4532b63adee2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:04.094776 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] Created reservations ['2435078d-e5c1-45c6-84ca-f97c47bb9cff', '108abada-120b-49c6-a1d7-d858e96f9aa4', '9b03c16e-1d51-405e-b8d2-47e88fb8d066', '35079ba8-2cb8-4c7e-a340-98f413ce1784'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:04.371894 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:04.424313 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:04.477396 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:36:04.484878 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] Deleted volume successfully. Feb 12 21:36:04.727620 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-40be6f5b-ee5f-4165-bd3f-6245553f53c6 tempest-VolumesImageMetadata-89090742 None] Lock "b'cinder-e124127c-5ac3-4842-bad0-5349300c177d-delete_volume'" released by "delete_volume" :: held 13.886s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:04.778100 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:04.856057 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:04.883789 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:36:04.893707 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] Deleted volume successfully. Feb 12 21:36:05.096295 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f2412986-c0c4-450a-b92f-510a5961c13c tempest-VolumesSnapshotListTestJSON-3976893 None] Lock "b'cinder-3cf35c3d-a1f0-4712-ab3f-030663dbd33f-delete_volume'" released by "delete_volume" :: held 10.378s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:08.773762 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:36:08.779079 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:36:08.779529 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:36:08.805545 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Flow 'volume_create_manager' (ea36356f-4e46-4b2f-a85f-659f1e3353fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:08.812622 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa6a659-7005-4f6b-b0f5-fd390c3e96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:08.819902 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:36:08.836069 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa6a659-7005-4f6b-b0f5-fd390c3e96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2114430985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae0eddaf-4dd3-467c-8dd9-75fa66fd5784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7d87d17ed242a2b52d4415cc7383b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:36:09Z,use_quota=True,user_id='97538c70b4484f4bbc222ce4308a462c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:08.841929 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19ce9a7-724c-492d-8c32-bc0f87259679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:08.846491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19ce9a7-724c-492d-8c32-bc0f87259679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:08.855885 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d5dcf6-2b03-4dbe-9b72-379a96215711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:08.867545 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d5dcf6-2b03-4dbe-9b72-379a96215711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0eddaf-4dd3-467c-8dd9-75fa66fd5784', 'volume_name': 'volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:08.867545 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056dda44-6002-41ef-8508-e8a3fe14f8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:08.870923 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056dda44-6002-41ef-8508-e8a3fe14f8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:08.875910 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a773fce3-bd44-41a3-ae4f-415cbd077857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:08.877020 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Volume ae0eddaf-4dd3-467c-8dd9-75fa66fd5784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784', 'volume_size': 1} Feb 12 21:36:08.877464 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] creating volume 'volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:36:08.878493 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:09.477256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:36:09.478868 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:36:09.479307 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:36:09.500096 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Flow 'volume_create_manager' (29391d0e-4093-4dbe-bbe6-ccf472f9a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:09.508163 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2689f431-30e8-4b99-a54b-14e5e0efc4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:09.516158 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:36:09.535761 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2689f431-30e8-4b99-a54b-14e5e0efc4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1072687160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3efdf6b-51d6-49e8-8812-eba158d05bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba2af975d234bf8868fd234c14f2bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:36:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:36:09Z,use_quota=True,user_id='463613e396cc45429d6f04e59d5b2ae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:09.541602 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f478186-87e9-45a3-8938-4994498b1861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:09.545985 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f478186-87e9-45a3-8938-4994498b1861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:09.551244 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559b314b-693e-422b-ae3c-060d65cf5d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:09.556154 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559b314b-693e-422b-ae3c-060d65cf5d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3efdf6b-51d6-49e8-8812-eba158d05bcb', 'volume_name': 'volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb', 'volume_size': 2}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:09.561218 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03b6cbc-d14d-4887-83b4-84d53b62dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:09.565413 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03b6cbc-d14d-4887-83b4-84d53b62dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:09.571027 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27058174-5322-464d-bf76-17be713bdc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:09.572101 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Volume b3efdf6b-51d6-49e8-8812-eba158d05bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb', 'volume_size': 2} Feb 12 21:36:09.572487 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] creating volume 'volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:36:09.573482 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:09.886739 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:36:09.887434 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:36:09.891651 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a773fce3-bd44-41a3-ae4f-415cbd077857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:09.897062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afbb807-eedd-46b5-9446-e3e2d1683dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:10.014856 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Volume volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784 (ae0eddaf-4dd3-467c-8dd9-75fa66fd5784): created successfully Feb 12 21:36:10.015993 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afbb807-eedd-46b5-9446-e3e2d1683dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:10.022997 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Flow 'volume_create_manager' (ea36356f-4e46-4b2f-a85f-659f1e3353fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:10.090993 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2bf9d43a-ccea-41b2-a73b-85e3489d5582 tempest-VolumesDeleteCascade-1808891868 None] Created volume successfully. Feb 12 21:36:10.551610 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:36:10.552015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:36:10.556633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27058174-5322-464d-bf76-17be713bdc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb', 'volume_size': 2}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:10.561774 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bf9ef2-add4-4f76-b133-cdf8b61ce5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:10.666159 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Volume volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb (b3efdf6b-51d6-49e8-8812-eba158d05bcb): created successfully Feb 12 21:36:10.669977 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bf9ef2-add4-4f76-b133-cdf8b61ce5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:10.675620 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Flow 'volume_create_manager' (29391d0e-4093-4dbe-bbe6-ccf472f9a357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:10.786205 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-97a956cb-f9f4-450d-9587-04f203118840 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Created volume successfully. Feb 12 21:36:11.296777 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-77cb47f1-49ec-4832-8a08-97703cdc9b5a tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:11.818584 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:36:11.818584 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:11.841021 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:11.863739 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:36:11.980348 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b39d73c8-3046-401a-93f6-35940a65364a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:15.414843 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-77cb47f1-49ec-4832-8a08-97703cdc9b5a tempest-VolumesDeleteCascade-1808891868 None] Create snapshot completed successfully Feb 12 21:36:15.568943 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b39d73c8-3046-401a-93f6-35940a65364a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Create snapshot completed successfully Feb 12 21:36:16.058979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-42d6c14f-0d52-4326-b312-5c333a367aa0 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Lock "b'cinder-e1dd29a9-d625-4325-b4ea-1f142a9aafa9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:36:16.060368 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-42d6c14f-0d52-4326-b312-5c333a367aa0 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:16.793670 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-9e6fa583-2969-4232-9388-d0b2a411a488 tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:20.422657 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-42d6c14f-0d52-4326-b312-5c333a367aa0 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Created reservations ['5190137b-00ce-4dc0-991a-f8bc8b03f1d7', 'f29cb5a3-c46a-4e94-985f-e2a6464aa97a', 'db047caf-a8b8-4bec-9a04-4033b50d1a03', '9043eed5-eecd-4a7d-9218-0fcc4e04a3a2'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:20.576477 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-42d6c14f-0d52-4326-b312-5c333a367aa0 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Delete snapshot completed successfully. Feb 12 21:36:20.581011 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-42d6c14f-0d52-4326-b312-5c333a367aa0 tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Lock "b'cinder-e1dd29a9-d625-4325-b4ea-1f142a9aafa9-delete_snapshot'" released by "delete_snapshot" :: held 4.522s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:21.256660 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-9e6fa583-2969-4232-9388-d0b2a411a488 tempest-VolumesDeleteCascade-1808891868 None] Create snapshot completed successfully Feb 12 21:36:21.392565 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Lock "b'cinder-b3efdf6b-51d6-49e8-8812-eba158d05bcb-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:36:21.500295 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:21.728792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:36:21.729233 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Volume volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:36:21.937503 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] deleting rbd volume volume-b3efdf6b-51d6-49e8-8812-eba158d05bcb {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:36:22.100844 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Lock "b'cinder-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:36:22.222218 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Performing cascade delete. {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Feb 12 21:36:22.240046 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Lock "b'cinder-303892d6-8ceb-494f-a99c-e3cbfc9abaf3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:36:22.252173 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:26.460414 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Created reservations ['3b3d3254-9133-492c-86df-3831d3965f0a', '7b321ebf-4dd1-4993-9a52-e68da61b0e65', 'dadff23e-0cf2-4f71-922b-7237045cc7e0', '5e503899-303b-44e2-ba12-58ca39d5dc1f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:26.610933 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Delete snapshot completed successfully. Feb 12 21:36:26.616573 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Lock "b'cinder-303892d6-8ceb-494f-a99c-e3cbfc9abaf3-delete_snapshot'" released by "delete_snapshot" :: held 4.375s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:26.623100 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Lock "b'cinder-70f7665e-7b6e-410f-aaa6-c38eb3cf8730-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:36:26.635797 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:28.277923 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Created reservations ['312bce7d-82a8-4877-a59a-074d94356da3', 'f6cd431d-d7ef-4b66-9543-3e00bec5b189', '4c0c1869-2633-4f20-9654-2f71a620e868', '462bb789-99e7-42c7-828d-056f31e082c9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:28.460974 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:28.485098 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:28.509491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:36:28.513785 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Deleted volume successfully. Feb 12 21:36:28.572393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-041e006b-e06f-4482-a393-20c13c0df49a tempest-VolumesSnapshotNegativeTestJSON-1060349981 None] Lock "b'cinder-b3efdf6b-51d6-49e8-8812-eba158d05bcb-delete_volume'" released by "delete_volume" :: held 7.180s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:30.222732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Created reservations ['8055bf23-2f70-4794-83cc-8b083a377e6e', '27348cea-b7fc-4c8f-af0c-f3f3b1ed7e1d', 'b320858c-07cf-4926-a9f8-e2ca36c82b92', '32493bb4-c8be-4f6f-a5fa-2ec840a28afc'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:30.399468 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Delete snapshot completed successfully. Feb 12 21:36:30.404964 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Lock "b'cinder-70f7665e-7b6e-410f-aaa6-c38eb3cf8730-delete_snapshot'" released by "delete_snapshot" :: held 3.782s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:30.405687 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Snapshots deleted, issuing volume delete {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Feb 12 21:36:30.406982 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:30.671469 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:36:30.671820 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Volume volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:36:30.883396 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] deleting rbd volume volume-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:36:38.395248 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Created reservations ['125f4979-43e2-4447-8c44-35e142e4d4a3', '045562b3-77a7-4baf-9543-b9635c25a6aa', 'd6d49a75-f9e5-46f8-bcf6-71269f95127c', 'f5746545-ed97-4dc8-a0a9-3887e86af2d1'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:38.605995 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:38.666420 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:38.765795 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:36:38.774819 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Deleted volume successfully. Feb 12 21:36:38.846935 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5bf9f760-0671-42a9-b6ad-e722fa2166ab tempest-VolumesDeleteCascade-1808891868 None] Lock "b'cinder-ae0eddaf-4dd3-467c-8dd9-75fa66fd5784-delete_volume'" released by "delete_volume" :: held 16.746s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:42.970122 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:36:42.973667 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:36:42.974122 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:36:42.995876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Flow 'volume_create_manager' (04df6a30-302d-4e6f-8e35-6aa961aa2c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:43.002710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412dfc73-71c9-4546-a6d4-ee09d7f83941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:43.009340 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:36:43.026373 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412dfc73-71c9-4546-a6d4-ee09d7f83941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-893622140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90d9e308-6fc6-465d-9af6-6ecbebd29be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8649cecb16f4712a37180aca794a349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:36:43Z,use_quota=True,user_id='864dbfd587324fb9b8f1d31f0197adb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:43.032445 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98e41c6-d0f6-47dc-8dd5-844cedcc62b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:43.036849 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98e41c6-d0f6-47dc-8dd5-844cedcc62b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:43.043106 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1d3065-aebb-4df1-b22b-f2288a757246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:43.053095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1d3065-aebb-4df1-b22b-f2288a757246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d9e308-6fc6-465d-9af6-6ecbebd29be4', 'volume_name': 'volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:43.053095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78331e1-b27d-4678-9372-1cc8bd1a345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:43.056874 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78331e1-b27d-4678-9372-1cc8bd1a345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:43.061800 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0714a551-ef33-4652-be3f-6f0a26ab000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:43.062896 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Volume 90d9e308-6fc6-465d-9af6-6ecbebd29be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4', 'volume_size': 1} Feb 12 21:36:43.063288 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] creating volume 'volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:36:43.064277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:44.054433 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:36:44.055075 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:36:44.059785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0714a551-ef33-4652-be3f-6f0a26ab000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:44.064552 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a714b4a9-00f1-4faa-b634-a7bb1551a122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:44.165532 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Volume volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4 (90d9e308-6fc6-465d-9af6-6ecbebd29be4): created successfully Feb 12 21:36:44.170571 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a714b4a9-00f1-4faa-b634-a7bb1551a122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:44.176336 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Flow 'volume_create_manager' (04df6a30-302d-4e6f-8e35-6aa961aa2c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:44.273924 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3695393b-c1f4-45a1-9fc3-6e9a9bd0678d tempest-VolumesMetadataTest-2105232488 None] Created volume successfully. Feb 12 21:36:46.178785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] Lock "b'cinder-90d9e308-6fc6-465d-9af6-6ecbebd29be4-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:36:46.304858 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:46.488124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:36:46.488554 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] Volume volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:36:46.720203 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] deleting rbd volume volume-90d9e308-6fc6-465d-9af6-6ecbebd29be4 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:36:53.616606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] Created reservations ['f2137dc3-a2ae-4440-bf47-44066ae101e0', 'f66c11ce-16c8-45e9-8388-ce6c5f50782a', '0a716803-0942-4bc2-ad03-1bd65b618e02', '6281ffe1-75e1-47de-b108-45f702d1f950'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:36:53.917469 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:53.940227 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:36:53.962732 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:36:53.968402 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] Deleted volume successfully. Feb 12 21:36:54.117807 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-8ed825bf-0f32-4c94-9221-be5ccd92d9d1 tempest-VolumesMetadataTest-2105232488 None] Lock "b'cinder-90d9e308-6fc6-465d-9af6-6ecbebd29be4-delete_volume'" released by "delete_volume" :: held 7.939s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:36:59.689792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:36:59.693143 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:36:59.693621 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:36:59.713383 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Flow 'volume_create_manager' (124e898f-9628-4212-9dd2-550e13036c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:36:59.720803 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66882ee8-1736-4a9f-a67b-c93a313c4d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:59.727148 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:36:59.741378 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66882ee8-1736-4a9f-a67b-c93a313c4d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1078385985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4550392e-b5fb-4d79-997f-effee4cd277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcfca642939f45c8b5206a3dd6d544df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:37:00Z,use_quota=True,user_id='4fbb3afd157d4a5f870c473f1c5ae71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:59.746975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a28ece6-1468-46b7-882f-730adcf1ab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:59.751477 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a28ece6-1468-46b7-882f-730adcf1ab6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:59.756687 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d64c4c-bcd0-498a-aac7-9c47f4900693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:59.760955 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d64c4c-bcd0-498a-aac7-9c47f4900693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4550392e-b5fb-4d79-997f-effee4cd277b', 'volume_name': 'volume-4550392e-b5fb-4d79-997f-effee4cd277b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:59.766794 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc26a1d0-14a7-41fc-a50c-31fb5bef3632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:59.770876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc26a1d0-14a7-41fc-a50c-31fb5bef3632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:36:59.775654 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51cd361-39ab-494c-b244-e8a85ad7f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:36:59.776713 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Volume 4550392e-b5fb-4d79-997f-effee4cd277b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4550392e-b5fb-4d79-997f-effee4cd277b', 'volume_size': 1} Feb 12 21:36:59.777095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] creating volume 'volume-4550392e-b5fb-4d79-997f-effee4cd277b' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:36:59.778088 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:00.651072 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:37:00.651447 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:37:00.655510 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51cd361-39ab-494c-b244-e8a85ad7f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4550392e-b5fb-4d79-997f-effee4cd277b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:00.660393 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44208dfc-8b3b-4c07-98f9-1deff1fe6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:00.756692 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Volume volume-4550392e-b5fb-4d79-997f-effee4cd277b (4550392e-b5fb-4d79-997f-effee4cd277b): created successfully Feb 12 21:37:00.760633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44208dfc-8b3b-4c07-98f9-1deff1fe6e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:00.767065 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Flow 'volume_create_manager' (124e898f-9628-4212-9dd2-550e13036c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:00.850697 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-fd1ac2ad-0cd1-4c47-9b59-b73d364175bb tempest-VolumesTransfersV355Test-942334059 None] Created volume successfully. Feb 12 21:37:02.675268 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1235a982-1202-4cfd-b82c-2db2ec074013 tempest-VolumesTransfersV355Test-269837558 None] Transfer volume completed successfully. Feb 12 21:37:03.644588 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] Lock "b'cinder-4550392e-b5fb-4d79-997f-effee4cd277b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:03.737327 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:03.923187 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:37:03.924259 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] Volume volume-4550392e-b5fb-4d79-997f-effee4cd277b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:04.105975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] deleting rbd volume volume-4550392e-b5fb-4d79-997f-effee4cd277b {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:37:11.386202 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] Created reservations ['99a50971-42cd-44b5-8cc1-a5e64aa63aed', '9949b4b5-cb65-4452-b896-211196fbfb0c', 'ebf9b4bc-b2e9-452c-8ce0-c66c19d86b3a', '4468e5d8-0d43-48d1-9608-dcea86419594'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:37:11.561048 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:11.583468 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:11.606770 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:37:11.610933 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] Deleted volume successfully. Feb 12 21:37:11.720942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d523b4fa-ed29-4433-942d-53a29da3aa28 tempest-VolumesTransfersV355Test-293155157 None] Lock "b'cinder-4550392e-b5fb-4d79-997f-effee4cd277b-delete_volume'" released by "delete_volume" :: held 8.076s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:37:11.820558 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:37:11.821261 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:11.843043 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:11.864068 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:37:12.904139 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:37:12.912669 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:37:12.912669 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:37:12.928821 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Flow 'volume_create_manager' (b8f46a07-5e4f-44a9-8eab-0e57b5add6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:12.935825 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da7f8a2-65f9-4c15-bf83-f89430463724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:12.942732 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:37:12.960242 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da7f8a2-65f9-4c15-bf83-f89430463724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1165914920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=832fe98c-a3e5-4b46-83ac-bbd91b886967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcfca642939f45c8b5206a3dd6d544df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:37:13Z,use_quota=True,user_id='4fbb3afd157d4a5f870c473f1c5ae71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:12.965909 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168ea457-55ff-444f-a218-52a914320b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:12.970489 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168ea457-55ff-444f-a218-52a914320b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:12.976432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7c852a-8929-4351-9352-03964246f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:12.980854 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7c852a-8929-4351-9352-03964246f726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832fe98c-a3e5-4b46-83ac-bbd91b886967', 'volume_name': 'volume-832fe98c-a3e5-4b46-83ac-bbd91b886967', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:12.986030 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9a01be-6348-4bc6-bedb-20f0310ec6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:12.990982 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9a01be-6348-4bc6-bedb-20f0310ec6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:12.996015 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961a82c0-5a1d-4f26-8567-a25c4ea8fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:12.997075 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Volume 832fe98c-a3e5-4b46-83ac-bbd91b886967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832fe98c-a3e5-4b46-83ac-bbd91b886967', 'volume_size': 1} Feb 12 21:37:12.997496 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] creating volume 'volume-832fe98c-a3e5-4b46-83ac-bbd91b886967' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:37:12.998487 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:13.032423 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-ccb618c3-b424-411b-8430-47b108900ddb req-7bfb3d9c-497c-445b-9f85-51b0a5019778 tempest-TestVolumeBackupRestore-1020972158 None] Terminate volume connection completed successfully. Feb 12 21:37:13.032767 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-ccb618c3-b424-411b-8430-47b108900ddb req-7bfb3d9c-497c-445b-9f85-51b0a5019778 tempest-TestVolumeBackupRestore-1020972158 None] Deleting attachment d831ee04-1e4e-4809-9413-91a6cdc2f1e0. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:37:13.511136 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:37:13.511513 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:37:13.515378 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961a82c0-5a1d-4f26-8567-a25c4ea8fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832fe98c-a3e5-4b46-83ac-bbd91b886967', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:13.520169 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1ecc66-3f53-4539-9d1b-1d14b7121f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:13.619632 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Volume volume-832fe98c-a3e5-4b46-83ac-bbd91b886967 (832fe98c-a3e5-4b46-83ac-bbd91b886967): created successfully Feb 12 21:37:13.624403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1ecc66-3f53-4539-9d1b-1d14b7121f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:13.630833 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Flow 'volume_create_manager' (b8f46a07-5e4f-44a9-8eab-0e57b5add6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:13.711047 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-4ed7bfd9-a429-4737-8295-830ce9af18e1 tempest-VolumesTransfersV355Test-942334059 None] Created volume successfully. Feb 12 21:37:14.538215 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] Lock "b'cinder-832fe98c-a3e5-4b46-83ac-bbd91b886967-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:14.637267 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:14.796316 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:37:14.797005 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] Volume volume-832fe98c-a3e5-4b46-83ac-bbd91b886967 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:14.871031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] deleting rbd volume volume-832fe98c-a3e5-4b46-83ac-bbd91b886967 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:37:14.961169 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] Lock "b'cinder-29b7e6aa-158b-4248-a1b3-80e64eeff62a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:15.111742 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:17.590227 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] Volume volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:18.251409 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] deleting rbd volume volume-29b7e6aa-158b-4248-a1b3-80e64eeff62a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:37:18.265002 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] Lock "b'cinder-b3511a55-12b4-476c-b22f-f927dc31e59a-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:18.344932 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:22.150400 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] deleting rbd volume volume-b3511a55-12b4-476c-b22f-f927dc31e59a {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:37:22.279353 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] Created reservations ['37f711ef-2167-4994-993f-10b29e9874eb', '71fa750f-2c0b-4157-aa57-707effbaab3c', '47046c32-34a9-4c2f-a35a-9e0651b26f77', 'c104f27c-4078-4817-ae0e-d8d3565e2f5e'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:37:22.534441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:22.557029 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:22.579608 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:37:22.583607 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] Deleted volume successfully. Feb 12 21:37:22.646324 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-5f8c1dfd-4c1f-4e34-8cff-18fe56bc05bf tempest-VolumesTransfersV355Test-293155157 None] Lock "b'cinder-832fe98c-a3e5-4b46-83ac-bbd91b886967-delete_volume'" released by "delete_volume" :: held 8.111s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:37:29.004073 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:37:29.007460 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:37:29.007906 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:37:29.028206 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (c80bec8c-0d71-4903-bc5d-22e76afe2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:29.035133 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62135f27-aef6-4b94-811c-256a064f47b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:29.041149 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:37:29.054962 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62135f27-aef6-4b94-811c-256a064f47b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-278451332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0252774d-f7f1-4594-907a-1e9aa6ffdbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a2913219654b37ba1f1f81e6273235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:37:29Z,use_quota=True,user_id='003120f377eb41a49713917bf8950185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:29.060636 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f16e21-bcee-4945-a0c2-df6fd9cd985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:29.064876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f16e21-bcee-4945-a0c2-df6fd9cd985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:29.070189 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20ab06f-e9cc-4e93-bc66-d41ec618dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:29.151272 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20ab06f-e9cc-4e93-bc66-d41ec618dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'volume_name': 'volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:29.156452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f86e6f6-57b6-48e2-88c3-ad46374864c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:29.160873 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f86e6f6-57b6-48e2-88c3-ad46374864c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:29.165766 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0511d2d-c0ed-454a-9ca2-bcc2e087feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:29.167033 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Volume 0252774d-f7f1-4594-907a-1e9aa6ffdbc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 21:37:29.167590 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Cloning 0252774d-f7f1-4594-907a-1e9aa6ffdbc8 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 21:37:29.178405 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:29.279297 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 37, 29, 181077)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:37:29.279710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:37:29.280109 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 21:37:29.284624 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.108s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:37:29.285502 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 21:37:29.291710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 21, 37, 29, 289298)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 21:37:29.292124 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 21:37:29.292508 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 21:37:29.303402 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:29.550773 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] creating snapshot='volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:37:31.794436 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8.clone_snap' to 'volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:37:31.806633 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:37:32.073149 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] deleting parent snapshot volume-b3511a55-12b4-476c-b22f-f927dc31e59a.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:37:34.603347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:34.605534 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:37:34.605985 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:37:34.920771 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:37:34.921750 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Marking volume 0252774d-f7f1-4594-907a-1e9aa6ffdbc8 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:37:35.025667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 0252774d-f7f1-4594-907a-1e9aa6ffdbc8. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 21:37:35.026185 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Creating volume glance metadata for volume 0252774d-f7f1-4594-907a-1e9aa6ffdbc8 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 21:37:35.059808 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] Created reservations ['be48cc61-829d-4003-a3a0-6b87c62098bb', '2cc454ed-722c-461b-8a86-bbf60342a65e', 'a0711c48-00da-498e-bd53-85fe78ab9277', '3c232f92-47e2-4d3d-b116-f84b805742ff'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:37:35.133784 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] Created reservations ['f4e43b06-0c2f-47c0-b704-13a6c59c7c71', '86fc55aa-e1ff-4a11-b523-fc75aaff7cab', '409980ee-3587-4bda-ab2b-0c3d1be73da1', '9ad10263-ce39-4207-aa21-c436381d24e9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:37:35.168679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0511d2d-c0ed-454a-9ca2-bcc2e087feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:35.173643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb3c4ec-2e3c-4afe-a03f-215b84b96771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:35.267342 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Volume volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8 (0252774d-f7f1-4594-907a-1e9aa6ffdbc8): created successfully Feb 12 21:37:35.284938 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb3c4ec-2e3c-4afe-a03f-215b84b96771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:35.320070 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (c80bec8c-0d71-4903-bc5d-22e76afe2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:35.326933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:35.385450 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:35.429197 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:37:35.435288 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] Deleted volume successfully. Feb 12 21:37:35.544727 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-6ecdfb91-e2f9-499e-8f67-26e9ee984aa4 tempest-VolumesCloneTest-1954509835 None] Created volume successfully. Feb 12 21:37:35.568388 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:35.611754 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:35.643961 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:37:35.651071 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] Deleted volume successfully. Feb 12 21:37:35.655616 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f463e783-1d67-4c4b-be72-9795ecb74bb7 tempest-TestVolumeBackupRestore-1020972158 None] Lock "b'cinder-29b7e6aa-158b-4248-a1b3-80e64eeff62a-delete_volume'" released by "delete_volume" :: held 20.695s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:37:35.760787 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-f361f553-79d7-4f3d-ba56-929687aaf04c tempest-TestVolumeBackupRestore-1020972158 None] Lock "b'cinder-b3511a55-12b4-476c-b22f-f927dc31e59a-delete_volume'" released by "delete_volume" :: held 17.496s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:37:37.461952 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:37:37.469140 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:37:37.470665 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:37:37.516602 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (baeae67d-c823-49c1-a56c-2566d4bd6bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:37.523838 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6664fa2c-99b2-4947-8dac-2e3daafdd0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:37.532491 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:37:37.558640 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6664fa2c-99b2-4947-8dac-2e3daafdd0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-630781048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e7aac94-1560-4b23-a40c-3dd3d74a0ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a2913219654b37ba1f1f81e6273235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0252774d-f7f1-4594-907a-1e9aa6ffdbc8,status='creating',terminated_at=None,updated_at=2022-02-12T21:37:37Z,use_quota=True,user_id='003120f377eb41a49713917bf8950185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:37.561710 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8342384c-7924-44e0-8a02-1d3e7d932cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:37.566403 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8342384c-7924-44e0-8a02-1d3e7d932cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:37.572269 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833ba078-14dc-467e-8bd7-7c0bceaa352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:37.592395 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833ba078-14dc-467e-8bd7-7c0bceaa352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5e7aac94-1560-4b23-a40c-3dd3d74a0ff8', 'volume_name': 'volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8', 'volume_size': 1, 'source_volid': '0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'source_volstatus': 'available'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:37.598988 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014f0175-d673-4dfc-83f5-9745f75c6073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:37.604853 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014f0175-d673-4dfc-83f5-9745f75c6073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:37.611708 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31891001-c561-442b-8b40-4d62714fb894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:37.612930 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Volume 5e7aac94-1560-4b23-a40c-3dd3d74a0ff8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8', 'volume_size': 1, 'source_volid': '0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'source_volstatus': 'available'} Feb 12 21:37:37.629426 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:37.818843 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] creating snapshot='volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:37:39.880517 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] cloning 'volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8@volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8.clone_snap' to 'volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:37:41.223427 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:41.225290 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:37:41.225925 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:37:41.551424 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:37:41.553049 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Marking volume 5e7aac94-1560-4b23-a40c-3dd3d74a0ff8 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 21:37:41.659303 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Copying metadata from source volume 0252774d-f7f1-4594-907a-1e9aa6ffdbc8 to 5e7aac94-1560-4b23-a40c-3dd3d74a0ff8. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Feb 12 21:37:41.848366 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31891001-c561-442b-8b40-4d62714fb894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8', 'volume_size': 1, 'source_volid': '0252774d-f7f1-4594-907a-1e9aa6ffdbc8', 'source_volstatus': 'available'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:41.868374 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a997b0-e3bb-44f5-97cf-64dac4ba44a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:41.936738 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Volume volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8 (5e7aac94-1560-4b23-a40c-3dd3d74a0ff8): created successfully Feb 12 21:37:41.942371 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a997b0-e3bb-44f5-97cf-64dac4ba44a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:41.949281 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (baeae67d-c823-49c1-a56c-2566d4bd6bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:42.011805 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-3efea760-67f9-4ebe-9734-d1b45d8fc9af tempest-VolumesCloneTest-1954509835 None] Created volume successfully. Feb 12 21:37:43.649277 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:37:43.654398 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:37:43.655051 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:37:43.678385 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (38f70a95-d2ac-4612-8d68-76aa7241b397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:43.687099 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55258767-0f95-4b31-8824-9325d6e3cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:43.714207 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:37:43.747425 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55258767-0f95-4b31-8824-9325d6e3cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1263389234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=37c6c29d-a86c-4647-af6f-768614790a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a2913219654b37ba1f1f81e6273235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:37:43Z,use_quota=True,user_id='003120f377eb41a49713917bf8950185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:43.763905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3940d7-f12f-4940-a72a-141bba7e11ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:43.774183 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3940d7-f12f-4940-a72a-141bba7e11ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:43.774985 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a44b99-8d92-4692-a7ca-409217d5780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:43.780515 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a44b99-8d92-4692-a7ca-409217d5780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c6c29d-a86c-4647-af6f-768614790a6b', 'volume_name': 'volume-37c6c29d-a86c-4647-af6f-768614790a6b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:43.786432 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c5deb1-21e8-460b-a6c7-8bad009190a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:43.791398 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c5deb1-21e8-460b-a6c7-8bad009190a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:43.810609 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab62eb6-f2c6-4d51-8247-55d3e7ef1e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:43.811758 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Volume 37c6c29d-a86c-4647-af6f-768614790a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c6c29d-a86c-4647-af6f-768614790a6b', 'volume_size': 1} Feb 12 21:37:43.812150 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] creating volume 'volume-37c6c29d-a86c-4647-af6f-768614790a6b' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:37:43.813162 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:44.362942 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:37:44.363321 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:37:44.367111 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab62eb6-f2c6-4d51-8247-55d3e7ef1e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c6c29d-a86c-4647-af6f-768614790a6b', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:44.372905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1e157a-a8bf-464d-a351-b6e3b1e0fce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:44.442070 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Volume volume-37c6c29d-a86c-4647-af6f-768614790a6b (37c6c29d-a86c-4647-af6f-768614790a6b): created successfully Feb 12 21:37:44.446642 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1e157a-a8bf-464d-a351-b6e3b1e0fce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:44.455887 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (38f70a95-d2ac-4612-8d68-76aa7241b397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:44.534483 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2e34b758-9b2d-40b6-b2a5-a735d4375adb tempest-VolumesCloneTest-1954509835 None] Created volume successfully. Feb 12 21:37:46.317863 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:37:46.321446 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:37:46.321892 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:37:46.350147 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (299ce44e-aa8b-402d-b363-fa9a1e7fe1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:46.357044 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400e67a0-bfa0-4794-ae7f-f587cabef264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:46.364054 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:37:46.378123 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400e67a0-bfa0-4794-ae7f-f587cabef264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-679970638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b1d2e05-0f69-4cf1-a619-6c7acdb30287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a2913219654b37ba1f1f81e6273235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:37:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=37c6c29d-a86c-4647-af6f-768614790a6b,status='creating',terminated_at=None,updated_at=2022-02-12T21:37:46Z,use_quota=True,user_id='003120f377eb41a49713917bf8950185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:46.383858 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6456c624-d128-43d4-8202-46ebb380db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:46.388834 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6456c624-d128-43d4-8202-46ebb380db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:46.394095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48e56da-8a12-4ed7-8083-2d840f634633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:46.410535 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48e56da-8a12-4ed7-8083-2d840f634633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b1d2e05-0f69-4cf1-a619-6c7acdb30287', 'volume_name': 'volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287', 'volume_size': 2, 'source_volid': '37c6c29d-a86c-4647-af6f-768614790a6b', 'source_volstatus': 'available'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:46.415844 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0ff67d-7f7d-43fb-838f-d3f1108b1065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:46.420047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0ff67d-7f7d-43fb-838f-d3f1108b1065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:46.425279 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305f7610-6e25-4d9c-8ad3-4f2c08fd22d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:46.426392 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Volume 8b1d2e05-0f69-4cf1-a619-6c7acdb30287: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287', 'volume_size': 2, 'source_volid': '37c6c29d-a86c-4647-af6f-768614790a6b', 'source_volstatus': 'available'} Feb 12 21:37:46.437678 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:46.664795 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] creating snapshot='volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 21:37:47.962674 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] cloning 'volume-37c6c29d-a86c-4647-af6f-768614790a6b@volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287.clone_snap' to 'volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 21:37:49.037397 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Volume volume-37c6c29d-a86c-4647-af6f-768614790a6b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:49.038693 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:37:49.039065 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:37:49.339442 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] resize volume 'volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287' from 1 to 2 {{(pid=134690) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Feb 12 21:37:49.340022 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:50.180603 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 21:37:50.185267 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305f7610-6e25-4d9c-8ad3-4f2c08fd22d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287', 'volume_size': 2, 'source_volid': '37c6c29d-a86c-4647-af6f-768614790a6b', 'source_volstatus': 'available'}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:50.190016 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a1bf0e-bc58-4466-a8e0-16ff5a660454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:37:50.281821 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Volume volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287 (8b1d2e05-0f69-4cf1-a619-6c7acdb30287): created successfully Feb 12 21:37:50.285856 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a1bf0e-bc58-4466-a8e0-16ff5a660454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:37:50.291502 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Flow 'volume_create_manager' (299ce44e-aa8b-402d-b363-fa9a1e7fe1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:37:50.381978 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2427f147-71be-4dbe-b388-dd3903edca4c tempest-VolumesCloneTest-1954509835 None] Created volume successfully. Feb 12 21:37:51.489980 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-8b1d2e05-0f69-4cf1-a619-6c7acdb30287-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:51.589078 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:51.716089 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:37:51.817792 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] deleting rbd volume volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:37:55.108711 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:37:55.222828 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] Volume volume-37c6c29d-a86c-4647-af6f-768614790a6b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:55.223543 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] deleting parent snapshot volume-8b1d2e05-0f69-4cf1-a619-6c7acdb30287.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:37:57.756546 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] Created reservations ['572ba110-66fa-434e-a219-44a56173f9a8', '93e4778a-ef4d-4ca6-a5aa-d942dc9db573', '1f533b4b-99e9-4219-a4f5-54f72378a284', 'fac8b4d1-d994-45e9-9c52-3228f40332a1'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:37:57.922928 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:57.949694 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:57.976177 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:37:57.981816 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] Deleted volume successfully. Feb 12 21:37:58.068590 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-4e57271b-9b90-4f31-972f-738b4ce2cdea tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-8b1d2e05-0f69-4cf1-a619-6c7acdb30287-delete_volume'" released by "delete_volume" :: held 6.579s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:37:59.040529 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-37c6c29d-a86c-4647-af6f-768614790a6b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:37:59.127238 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:37:59.270093 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:37:59.270519 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] Volume volume-37c6c29d-a86c-4647-af6f-768614790a6b is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:37:59.348685 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] deleting rbd volume volume-37c6c29d-a86c-4647-af6f-768614790a6b {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:38:02.619178 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] Created reservations ['c247c443-ad7f-4f66-9d25-2ed0844ace2c', '6e12d6de-4983-4346-ab2b-7c69a82d8a77', 'c43a171b-fc71-4f65-85e7-148ec1d666f9', '9f669552-2567-42dd-b161-1819e4c7f9d1'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:38:02.805696 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:02.836911 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:02.865047 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:38:02.869272 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] Deleted volume successfully. Feb 12 21:38:02.958361 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-d7a6e551-dcc2-4fb3-b633-a8e84a53638b tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-37c6c29d-a86c-4647-af6f-768614790a6b-delete_volume'" released by "delete_volume" :: held 3.918s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:38:03.565042 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:38:03.808660 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:04.522287 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:38:04.681424 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] deleting rbd volume volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:38:08.491681 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:38:08.655685 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] deleting parent snapshot volume-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:38:10.922004 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] Created reservations ['6db9fe60-8226-4daa-9c33-2a3c345535c8', 'b0a42b7c-8ee3-4a4f-a259-7708b82ad975', 'b902d26a-14d0-44c5-9f2e-d8aec9387807', '62b74898-3ebd-48b3-adc2-bc32c0571d5f'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:38:11.131958 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:11.167795 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:11.209673 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:38:11.213905 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] Deleted volume successfully. Feb 12 21:38:11.241977 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-0252774d-f7f1-4594-907a-1e9aa6ffdbc8-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:38:11.319031 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-e10c06e2-2425-41e7-bbf8-d3d44c9f4883 tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-5e7aac94-1560-4b23-a40c-3dd3d74a0ff8-delete_volume'" released by "delete_volume" :: held 7.746s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:38:11.384146 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:11.546765 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:38:11.666370 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] deleting rbd volume volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:38:11.819453 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:38:11.820082 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:11.867394 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:11.908212 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:38:15.353267 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 21:38:15.610883 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] deleting parent snapshot volume-0252774d-f7f1-4594-907a-1e9aa6ffdbc8.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 21:38:17.646882 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] Created reservations ['0bc47872-4af6-49c6-994c-5ba8c342d04d', 'b6636ab0-8568-4e02-99f8-2506ab0b5ec0', 'e3fb1ebb-e27d-47e9-9f13-a3f664273677', 'e7213b5a-5582-43b9-89ba-ee79e0e6721d'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:38:17.903665 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:18.013787 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:38:18.223947 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:38:18.228010 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] Deleted volume successfully. Feb 12 21:38:18.312697 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-b5f1c5d9-eb7d-4ee1-a8cf-9fc8742b072d tempest-VolumesCloneTest-1954509835 None] Lock "b'cinder-0252774d-f7f1-4594-907a-1e9aa6ffdbc8-delete_volume'" released by "delete_volume" :: held 7.070s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:39:11.818077 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:39:11.819270 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:39:11.840863 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:39:11.863159 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:40:11.818779 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:40:11.820500 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:40:11.876066 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:40:11.908840 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:41:11.824188 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:41:11.824872 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:41:11.847365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:41:11.869666 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:42:11.824573 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:42:11.825492 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:42:11.854379 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:42:11.879367 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:43:11.824141 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:43:11.824783 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:43:11.859417 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:43:11.891074 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:44:11.826204 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:44:11.827511 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:44:11.849396 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:44:11.873083 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:45:11.829005 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:45:11.829734 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:45:11.914294 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:45:11.943322 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:46:11.830115 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:46:11.831452 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:46:11.853057 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:46:11.875220 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:47:11.830128 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:47:11.830945 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:47:11.864089 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:47:11.937632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:47:34.034477 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:47:34.037971 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:47:34.038799 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:47:34.061425 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Flow 'volume_create_manager' (17c2a24f-070d-4645-93fc-33cacf96e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:47:34.068615 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6207ea7f-cd88-47f8-b029-9c39e261918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:47:34.076684 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:47:34.091742 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6207ea7f-cd88-47f8-b029-9c39e261918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-23521989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d8b711c5-5e7d-49f4-852c-25b581c931a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902f92c068c04a1994a8d95036240a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:47:34Z,use_quota=True,user_id='3c8938385d324996b1f80337c56f69fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:47:34.097588 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d98a74-ae29-4895-9f92-caad48c9a5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:47:34.101946 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d98a74-ae29-4895-9f92-caad48c9a5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:47:34.108479 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a476dec7-dfab-4170-b2da-1cbb9e444102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:47:34.113566 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a476dec7-dfab-4170-b2da-1cbb9e444102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'volume_name': 'volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:47:34.119085 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b980d0ba-b2db-440c-bf39-b2f69b2d2e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:47:34.123435 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b980d0ba-b2db-440c-bf39-b2f69b2d2e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:47:34.128759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a2c3d5-bba6-407b-bf6d-61330517d210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:47:34.129895 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Volume d8b711c5-5e7d-49f4-852c-25b581c931a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'volume_size': 1} Feb 12 21:47:34.130307 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] creating volume 'volume-d8b711c5-5e7d-49f4-852c-25b581c931a5' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:47:34.131287 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:47:34.619441 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:47:34.619778 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:47:34.623497 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a2c3d5-bba6-407b-bf6d-61330517d210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:47:34.628166 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7842717e-c5fb-46c6-9863-376b488988b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:47:34.723774 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Volume volume-d8b711c5-5e7d-49f4-852c-25b581c931a5 (d8b711c5-5e7d-49f4-852c-25b581c931a5): created successfully Feb 12 21:47:34.728205 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7842717e-c5fb-46c6-9863-376b488988b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:47:34.733883 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Flow 'volume_create_manager' (17c2a24f-070d-4645-93fc-33cacf96e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:47:34.804037 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-f4d2f810-fbc8-450a-8320-fc9f4cf7ffe1 tempest-ServerActionsTestJSON-123457624 None] Created volume successfully. Feb 12 21:47:35.984218 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-94db0b00-811b-4100-9ede-56ca2f7b9044 req-98fabccd-5015-4e4a-b6ef-55107dd964a8 tempest-ServerActionsTestJSON-123457624 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:47:36.620673 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-94db0b00-811b-4100-9ede-56ca2f7b9044 req-98fabccd-5015-4e4a-b6ef-55107dd964a8 tempest-ServerActionsTestJSON-123457624 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:47:36.621590 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-94db0b00-811b-4100-9ede-56ca2f7b9044 req-98fabccd-5015-4e4a-b6ef-55107dd964a8 tempest-ServerActionsTestJSON-123457624 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:47:36.735667 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-94db0b00-811b-4100-9ede-56ca2f7b9044 req-98fabccd-5015-4e4a-b6ef-55107dd964a8 tempest-ServerActionsTestJSON-123457624 None] Connection info returned from driver {'name': 'volumes/volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '26c40ca5-303b-4b55-bb7f-ad81fa6ced15'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:47:36.827309 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-94db0b00-811b-4100-9ede-56ca2f7b9044 req-98fabccd-5015-4e4a-b6ef-55107dd964a8 tempest-ServerActionsTestJSON-123457624 None] attachment_update completed successfully. Feb 12 21:48:00.986942 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-894b027b-d251-4c0b-b95c-6e964aada9df req-8b7f40cb-4e23-4314-bc46-b48e2604285b tempest-ServerActionsTestJSON-123457624 None] Terminate volume connection completed successfully. Feb 12 21:48:00.987607 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-894b027b-d251-4c0b-b95c-6e964aada9df req-8b7f40cb-4e23-4314-bc46-b48e2604285b tempest-ServerActionsTestJSON-123457624 None] Deleting attachment 26c40ca5-303b-4b55-bb7f-ad81fa6ced15. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:48:03.597843 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-894b027b-d251-4c0b-b95c-6e964aada9df req-ff918ef2-9be8-419c-b606-0a825e4f6841 tempest-ServerActionsTestJSON-123457624 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:48:04.302752 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-894b027b-d251-4c0b-b95c-6e964aada9df req-ff918ef2-9be8-419c-b606-0a825e4f6841 tempest-ServerActionsTestJSON-123457624 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.705s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:48:04.303587 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-894b027b-d251-4c0b-b95c-6e964aada9df req-ff918ef2-9be8-419c-b606-0a825e4f6841 tempest-ServerActionsTestJSON-123457624 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:48:04.398326 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-894b027b-d251-4c0b-b95c-6e964aada9df req-ff918ef2-9be8-419c-b606-0a825e4f6841 tempest-ServerActionsTestJSON-123457624 None] Connection info returned from driver {'name': 'volumes/volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ea4ff3a2-e95e-4a14-a657-c7600dc1ffed'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:48:04.514346 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-894b027b-d251-4c0b-b95c-6e964aada9df req-ff918ef2-9be8-419c-b606-0a825e4f6841 tempest-ServerActionsTestJSON-123457624 None] attachment_update completed successfully. Feb 12 21:48:11.833365 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:48:11.834505 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:48:11.883413 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:48:11.912984 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:48:12.064703 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-4c8005ed-636b-4f1f-a541-e077ff6f8255 tempest-ServerActionsTestJSON-123457624 None] Terminate volume connection completed successfully. Feb 12 21:48:12.065045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-4c8005ed-636b-4f1f-a541-e077ff6f8255 tempest-ServerActionsTestJSON-123457624 None] Deleting attachment ea4ff3a2-e95e-4a14-a657-c7600dc1ffed. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:48:14.970744 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-c14422bf-d55a-4a15-b187-99585f98b642 tempest-ServerActionsTestJSON-123457624 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:48:15.614161 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-c14422bf-d55a-4a15-b187-99585f98b642 tempest-ServerActionsTestJSON-123457624 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:48:15.614892 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-c14422bf-d55a-4a15-b187-99585f98b642 tempest-ServerActionsTestJSON-123457624 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:48:15.694940 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-c14422bf-d55a-4a15-b187-99585f98b642 tempest-ServerActionsTestJSON-123457624 None] Connection info returned from driver {'name': 'volumes/volume-d8b711c5-5e7d-49f4-852c-25b581c931a5', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd8b711c5-5e7d-49f4-852c-25b581c931a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '23509cce-d427-4129-8a2c-734b18cd5782'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:48:15.808816 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 req-c14422bf-d55a-4a15-b187-99585f98b642 tempest-ServerActionsTestJSON-123457624 None] attachment_update completed successfully. Feb 12 21:48:24.026311 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-18173bee-c5ce-4513-b5e1-70909b3b6b4c req-11af579d-f312-475b-8171-add703ae5041 tempest-ServerActionsTestJSON-123457624 None] Terminate volume connection completed successfully. Feb 12 21:48:24.033485 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-18173bee-c5ce-4513-b5e1-70909b3b6b4c req-11af579d-f312-475b-8171-add703ae5041 tempest-ServerActionsTestJSON-123457624 None] Deleting attachment 23509cce-d427-4129-8a2c-734b18cd5782. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:48:26.155365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] Lock "b'cinder-d8b711c5-5e7d-49f4-852c-25b581c931a5-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:48:26.221306 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:48:26.323252 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:48:26.323617 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] Volume volume-d8b711c5-5e7d-49f4-852c-25b581c931a5 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:48:26.431911 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] deleting rbd volume volume-d8b711c5-5e7d-49f4-852c-25b581c931a5 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:48:29.077262 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] Created reservations ['803934fa-a854-46a6-af1a-c8be80fb9e9e', 'b21576fe-b797-4731-8d7e-304b61a93c8a', 'b0651f8f-6ad5-4f94-8aa7-6872bc5eacc0', 'ab7727f3-7fc7-4c0d-8310-dc2b9c7cfdc9'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:48:29.249850 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:48:29.273967 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:48:29.302039 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:48:29.306312 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] Deleted volume successfully. Feb 12 21:48:29.368400 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-c7c25d15-a90a-47c1-bf9f-3e8b833de82d tempest-ServerActionsTestJSON-123457624 None] Lock "b'cinder-d8b711c5-5e7d-49f4-852c-25b581c931a5-delete_volume'" released by "delete_volume" :: held 3.213s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:49:11.839044 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:49:11.839652 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:49:11.862528 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:49:11.885390 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:50:11.841473 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:50:11.842271 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:50:11.884664 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:50:11.913071 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:50:20.174979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 21:50:20.178756 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 21:50:20.179269 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 21:50:20.200046 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Flow 'volume_create_manager' (1a7e8026-fcdd-4e47-a5ff-05c4288f2b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:50:20.207629 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c027f9e0-d2b9-4769-85d7-ea731d746381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:50:20.214110 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:50:20.228759 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c027f9e0-d2b9-4769-85d7-ea731d746381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T21:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-7319694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=faa73997-a56d-47de-8320-764458199373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d444f067e241a0ba61105f426bc943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T21:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T21:50:20Z,use_quota=True,user_id='452d610a87c2437b9eb07dd432a218e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:50:20.234365 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8013828a-ec8e-44c8-bf40-c35030121930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:50:20.239225 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8013828a-ec8e-44c8-bf40-c35030121930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:50:20.244594 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7fbba2-87f6-4ead-abac-e8f3b8988de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:50:20.248933 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7fbba2-87f6-4ead-abac-e8f3b8988de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa73997-a56d-47de-8320-764458199373', 'volume_name': 'volume-faa73997-a56d-47de-8320-764458199373', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:50:20.255189 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0ca1d8-5680-4c70-8929-7a70c9576939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:50:20.259293 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0ca1d8-5680-4c70-8929-7a70c9576939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:50:20.264195 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6d2711-6ed4-4b48-96ae-b3913da57664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:50:20.265316 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Volume faa73997-a56d-47de-8320-764458199373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa73997-a56d-47de-8320-764458199373', 'volume_size': 1} Feb 12 21:50:20.265740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] creating volume 'volume-faa73997-a56d-47de-8320-764458199373' {{(pid=134690) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Feb 12 21:50:20.267748 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:50:20.754301 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 21:50:20.754679 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 21:50:20.758572 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6d2711-6ed4-4b48-96ae-b3913da57664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa73997-a56d-47de-8320-764458199373', 'volume_size': 1}' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:50:20.763268 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa9ed32-0f45-4b28-a9fa-1972fa3ac37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 21:50:20.830666 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Volume volume-faa73997-a56d-47de-8320-764458199373 (faa73997-a56d-47de-8320-764458199373): created successfully Feb 12 21:50:20.834309 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa9ed32-0f45-4b28-a9fa-1972fa3ac37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 21:50:20.840033 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Flow 'volume_create_manager' (1a7e8026-fcdd-4e47-a5ff-05c4288f2b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 21:50:20.916249 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-d5af00ac-5584-445b-bbff-f275d34c888b tempest-TestMinimumBasicScenario-541339579 None] Created volume successfully. Feb 12 21:50:22.060060 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 req-2d084109-6ca0-44de-88c8-86fa27d266dc tempest-TestMinimumBasicScenario-541339579 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:50:22.720490 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 req-2d084109-6ca0-44de-88c8-86fa27d266dc tempest-TestMinimumBasicScenario-541339579 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.660s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:50:22.721245 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 req-2d084109-6ca0-44de-88c8-86fa27d266dc tempest-TestMinimumBasicScenario-541339579 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-faa73997-a56d-47de-8320-764458199373', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': 'faa73997-a56d-47de-8320-764458199373', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 21:50:22.801967 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 req-2d084109-6ca0-44de-88c8-86fa27d266dc tempest-TestMinimumBasicScenario-541339579 None] Connection info returned from driver {'name': 'volumes/volume-faa73997-a56d-47de-8320-764458199373', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'faa73997-a56d-47de-8320-764458199373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2780eca1-16e8-4646-b012-91302f61de9b'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 21:50:22.892816 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 req-2d084109-6ca0-44de-88c8-86fa27d266dc tempest-TestMinimumBasicScenario-541339579 None] attachment_update completed successfully. Feb 12 21:51:11.842643 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:51:11.843734 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:51:11.867683 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:51:11.892285 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:51:42.587886 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-ed1bf07f-7714-4899-91fb-522e618ee2eb req-13280e93-276a-4d47-a197-62b823f3c95f tempest-TestMinimumBasicScenario-541339579 None] Terminate volume connection completed successfully. Feb 12 21:51:42.588613 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-ed1bf07f-7714-4899-91fb-522e618ee2eb req-13280e93-276a-4d47-a197-62b823f3c95f tempest-TestMinimumBasicScenario-541339579 None] Deleting attachment 2780eca1-16e8-4646-b012-91302f61de9b. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 21:51:43.217511 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] Lock "b'cinder-faa73997-a56d-47de-8320-764458199373-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 21:51:43.333248 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:51:43.473643 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 21:51:43.474095 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] Volume volume-faa73997-a56d-47de-8320-764458199373 is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 21:51:43.583045 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] deleting rbd volume volume-faa73997-a56d-47de-8320-764458199373 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 21:51:46.588564 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] Created reservations ['50cda23d-8a54-44f6-a4c2-802ae7f9d300', 'f6d665b1-08d7-4b45-8149-f805cb880d05', '6d5eb5c9-63db-4f28-9e45-829d1a3dcdad', 'cbf44cda-aa96-434f-9b52-05bca818069e'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 21:51:46.779282 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:51:46.800686 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:51:46.824138 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:51:46.828413 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] Deleted volume successfully. Feb 12 21:51:46.919968 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-1342749b-e478-4bfe-a758-179d021c3c56 tempest-TestMinimumBasicScenario-541339579 None] Lock "b'cinder-faa73997-a56d-47de-8320-764458199373-delete_volume'" released by "delete_volume" :: held 3.703s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 21:52:11.838435 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:52:11.839063 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:52:11.867019 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:52:11.892895 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:53:11.838259 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:53:11.838977 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:53:11.873832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:53:11.903436 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:54:11.839161 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:54:11.839936 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:54:11.878601 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:54:11.903311 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:55:11.839145 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:55:11.839857 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:55:11.863130 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:55:11.885054 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:56:11.840608 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:56:11.841339 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:56:11.864062 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:56:11.890337 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:57:11.845192 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:57:11.845887 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:57:11.869682 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:57:11.894168 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:58:11.849617 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:58:11.850256 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:58:11.871785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:58:11.893860 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 21:59:11.849184 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 21:59:11.849857 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:59:11.871353 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 21:59:11.893665 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:00:11.848496 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:00:11.849176 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:00:11.873072 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:00:11.901428 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:01:11.846140 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:01:11.846875 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:01:11.916693 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:01:11.939416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:02:11.844486 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:02:11.845199 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:02:11.880991 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:02:11.904278 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:03:11.849991 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:03:11.850706 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:03:11.876370 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:03:11.915921 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:04:11.851150 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:04:11.851975 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:04:11.873164 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:04:11.895655 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:04:50.637345 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=134690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Feb 12 22:04:50.640953 ncdv-master-1 cinder-volume[134690]: WARNING stevedore.named [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 12 22:04:50.641458 ncdv-master-1 cinder-volume[134690]: WARNING castellan.key_manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 12 22:04:50.661577 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Flow 'volume_create_manager' (1bbfae18-e113-4204-97c7-81598519590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 22:04:50.668347 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4199478-25b6-49d4-ac4a-f4e6a99fb444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 22:04:50.674717 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_db.sqlalchemy.engines [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 22:04:50.689876 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4199478-25b6-49d4-ac4a-f4e6a99fb444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-02-12T22:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-949692769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e5e96c8-86e8-46c4-8182-fceff0f56d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707f6000ad794dbd92c57050b2f27387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-02-12T22:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-02-12T22:04:51Z,use_quota=True,user_id='c00440dbf100416c83f80be418e2a05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cc6c2-0a46-4618-9e8b-2833fca99c88),volume_type_id=5f5cc6c2-0a46-4618-9e8b-2833fca99c88)' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 22:04:50.696218 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21b844-bff2-4f27-8e00-28a89b5b59a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 22:04:50.700518 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21b844-bff2-4f27-8e00-28a89b5b59a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 22:04:50.705913 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102f7c34-b2a5-4a89-882e-b14ead0def4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 22:04:50.785838 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102f7c34-b2a5-4a89-882e-b14ead0def4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'volume_name': 'volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 22:04:50.790905 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbba1b9c-4743-4b4e-8e08-4af048d6647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 22:04:50.795013 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbba1b9c-4743-4b4e-8e08-4af048d6647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 22:04:50.799831 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb492da-e37f-4891-8cdc-0998d090bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 22:04:50.801507 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Volume 0e5e96c8-86e8-46c4-8182-fceff0f56d54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 12 22:04:50.802179 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Cloning 0e5e96c8-86e8-46c4-8182-fceff0f56d54 from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 at location (None, None). {{(pid=134690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Feb 12 22:04:50.810469 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 22:04:50.852423 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 22, 4, 50, 814446)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 22:04:50.852863 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 22:04:50.853266 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Found cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Feb 12 22:04:50.857224 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Lock "b'cinder-4a11baa3-e49c-4bef-9cb0-43274e3b71c9'" released by "_prepare_image_cache_entry" :: held 0.047s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 22:04:50.858135 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Attempting to retrieve cache entry for image = 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 on host ncdv-master-1@ceph#ceph. {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Feb 12 22:04:50.863491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Found image-volume cache entry: {'id': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'volume_id': '4bb25651-1519-432c-86fd-b2ea70a1a658', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18), 'last_used': datetime.datetime(2022, 2, 12, 22, 4, 50, 861302)}. {{(pid=134690) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Feb 12 22:04:50.866117 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.image.cache [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Image-volume cache entry image_update_at = 2022-02-12 20:53:18+00:00, requested image updated_at = 2022-02-12 20:53:18+00:00. {{(pid=134690) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Feb 12 22:04:50.866117 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Creating from source image-volume 4bb25651-1519-432c-86fd-b2ea70a1a658 {{(pid=134690) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Feb 12 22:04:50.875785 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:04:51.035109 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] creating snapshot='volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54.clone_snap' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Feb 12 22:04:52.481747 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] cloning 'volume-4bb25651-1519-432c-86fd-b2ea70a1a658@volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54.clone_snap' to 'volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54' {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Feb 12 22:04:53.403917 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Volume volume-e5b5c656-a8a4-478a-aad0-b56ab96de415.deleted is not a clone. {{(pid=134690) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Feb 12 22:04:53.405583 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Feb 12 22:04:53.405960 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=134690) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Feb 12 22:04:53.617110 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] clone created successfully {{(pid=134690) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Feb 12 22:04:53.617829 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.volume_utils [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Marking volume 0e5e96c8-86e8-46c4-8182-fceff0f56d54 as bootable. {{(pid=134690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} Feb 12 22:04:53.675506 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Copying metadata from image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 to 0e5e96c8-86e8-46c4-8182-fceff0f56d54. {{(pid=134690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Feb 12 22:04:53.675871 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Creating volume glance metadata for volume 0e5e96c8-86e8-46c4-8182-fceff0f56d54 backed by image 4a11baa3-e49c-4bef-9cb0-43274e3b71c9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=134690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Feb 12 22:04:53.764557 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb492da-e37f-4891-8cdc-0998d090bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'volume_size': 1, 'image_id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '440027c890594b2189b59db99bf67a14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '4a11baa3-e49c-4bef-9cb0-43274e3b71c9', 'created_at': datetime.datetime(2022, 2, 12, 20, 53, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 2, 12, 20, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 22:04:53.769491 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e62b19-52db-47b2-bf9b-15e2c8464021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Feb 12 22:04:53.812250 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.flows.manager.create_volume [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Volume volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54 (0e5e96c8-86e8-46c4-8182-fceff0f56d54): created successfully Feb 12 22:04:53.815979 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e62b19-52db-47b2-bf9b-15e2c8464021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=134690) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Feb 12 22:04:53.822435 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Flow 'volume_create_manager' (1bbfae18-e113-4204-97c7-81598519590a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=134690) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Feb 12 22:04:53.875048 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [None req-2331d287-6638-44f1-8673-3e8109c488c1 tempest-TestShelveInstance-1948701693 None] Created volume successfully. Feb 12 22:04:57.718888 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e req-dc093de7-9cb8-4655-a246-60b7e052944e tempest-TestShelveInstance-1948701693 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 22:04:58.418201 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_concurrency.processutils [req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e req-dc093de7-9cb8-4655-a246-60b7e052944e tempest-TestShelveInstance-1948701693 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.698s {{(pid=134690) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 22:04:58.419339 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e req-dc093de7-9cb8-4655-a246-60b7e052944e tempest-TestShelveInstance-1948701693 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '64d50166-8e0e-4d99-b380-f20f9972c7e5', 'volume_id': '0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'discard': True}} {{(pid=134690) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Feb 12 22:04:58.493312 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e req-dc093de7-9cb8-4655-a246-60b7e052944e tempest-TestShelveInstance-1948701693 None] Connection info returned from driver {'name': 'volumes/volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'hosts': ['10.222.0.31'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e5e96c8-86e8-46c4-8182-fceff0f56d54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ca1610b7-1797-43c4-bd23-a09ed12bce45'} {{(pid=134690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} Feb 12 22:04:58.589121 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e req-dc093de7-9cb8-4655-a246-60b7e052944e tempest-TestShelveInstance-1948701693 None] attachment_update completed successfully. Feb 12 22:05:11.851581 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:05:11.852777 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:05:11.892323 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:05:11.923237 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:06:11.849118 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:06:11.850343 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:06:11.872532 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:06:11.895740 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:07:11.851142 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:07:11.851819 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:07:11.874416 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:07:11.897957 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:08:11.852763 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:08:11.853485 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:08:11.874901 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:08:11.897230 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:08:34.398139 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-59527171-a601-4d10-9347-14edf3b52ed3 req-8d38fcdf-39cd-4735-849d-5d20d5efff11 tempest-TestShelveInstance-1948701693 None] Terminate volume connection completed successfully. Feb 12 22:08:34.398910 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.manager [req-59527171-a601-4d10-9347-14edf3b52ed3 req-8d38fcdf-39cd-4735-849d-5d20d5efff11 tempest-TestShelveInstance-1948701693 None] Deleting attachment ca1610b7-1797-43c4-bd23-a09ed12bce45. {{(pid=134690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4960}} Feb 12 22:08:34.791041 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] Lock "b'cinder-0e5e96c8-86e8-46c4-8182-fceff0f56d54-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Feb 12 22:08:34.886547 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:08:35.037868 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] volume has no backup snaps {{(pid=134690) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Feb 12 22:08:35.165448 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] deleting rbd volume volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54 {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Feb 12 22:08:38.990632 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] volume is a clone so cleaning references {{(pid=134690) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Feb 12 22:08:39.108196 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] deleting parent snapshot volume-0e5e96c8-86e8-46c4-8182-fceff0f56d54.clone_snap {{(pid=134690) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Feb 12 22:08:42.155716 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.quota [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] Created reservations ['88926ea6-4d26-40e8-aeb1-42574d092bd0', 'dee4530c-b99b-4c05-a019-40abe4200c7c', 'aa0cb412-3d8f-43cc-b22e-b9e02c990c9a', '7102a971-0b4c-475d-a3c7-060d3b7d23de'] {{(pid=134690) reserve /opt/stack/cinder/cinder/quota.py:755}} Feb 12 22:08:42.336213 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:08:42.361623 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:08:42.387237 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:08:42.393134 ncdv-master-1 cinder-volume[134690]: INFO cinder.volume.manager [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] Deleted volume successfully. Feb 12 22:08:42.454075 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.coordination [req-59527171-a601-4d10-9347-14edf3b52ed3 req-754ead3f-6b88-4f66-84e6-ec14cbd1eadd tempest-TestShelveInstance-1948701693 None] Lock "b'cinder-0e5e96c8-86e8-46c4-8182-fceff0f56d54-delete_volume'" released by "delete_volume" :: held 7.663s {{(pid=134690) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Feb 12 22:09:11.852794 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:09:11.853464 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:09:11.931583 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:09:11.959779 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:10:11.854558 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:10:11.855226 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:10:11.877054 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:10:11.898664 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:11:11.853798 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:11:11.854468 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:11:11.877400 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:11:11.898832 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:12:11.854058 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:12:11.854708 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:12:11.893967 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:12:11.916646 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:13:11.852384 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:13:11.853493 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:13:11.874034 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:13:11.896650 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:14:11.852766 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:14:11.853529 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:14:11.924310 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:14:11.947517 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:15:11.852552 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:15:11.853808 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:15:11.875407 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:15:11.897890 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:16:11.854205 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:16:11.855912 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:16:11.878794 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:16:11.901805 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:17:11.857459 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:17:11.858090 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:17:11.881651 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:17:11.905514 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:18:11.861093 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:18:11.861717 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:18:11.883684 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:18:11.906130 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:19:11.861345 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:19:11.862606 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:19:11.883655 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:19:11.906016 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:20:11.861243 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:20:11.861882 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:20:11.883091 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:20:11.904893 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 12 22:21:11.860298 ncdv-master-1 cinder-volume[134690]: DEBUG oslo_service.periodic_task [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=134690) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Feb 12 22:21:11.860914 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:21:11.881870 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.volume.drivers.rbd [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=134690) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Feb 12 22:21:11.904037 ncdv-master-1 cinder-volume[134690]: DEBUG cinder.manager [None req-78dbc180-e510-4d0f-9828-c9d547dc375b None None] Notifying Schedulers of capabilities ... {{(pid=134690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}