-- Logs begin at Sat 2022-01-15 20:01:13 UTC, end at Sat 2022-01-15 22:13:03 UTC. -- Jan 15 20:39:35.774405 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jan 15 20:39:39.094060 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=122554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 15 20:39:39.094658 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=122554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 15 20:39:39.493104 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_db.sqlalchemy.engines [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:39:39.797585 ncdv-master-1 cinder-volume[122554]: INFO cinder.rpc [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jan 15 20:39:39.801593 ncdv-master-1 cinder-volume[122554]: INFO cinder.rpc [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jan 15 20:39:39.808744 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_db.sqlalchemy.engines [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:39:39.872907 ncdv-master-1 cinder-volume[122554]: INFO cinder.volume.manager [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Determined volume DB was empty at startup. Jan 15 20:39:39.873505 ncdv-master-1 cinder-volume[122554]: DEBUG cinder.volume.manager [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=122554) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Jan 15 20:39:39.892889 ncdv-master-1 cinder-volume[122554]: INFO cinder.volume.manager [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Service not found for updating active_backend_id, assuming default for driver init. Jan 15 20:39:39.893962 ncdv-master-1 cinder-volume[122554]: WARNING stevedore.named [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:39:39.894442 ncdv-master-1 cinder-volume[122554]: WARNING castellan.key_manager [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:39:39.895749 ncdv-master-1 cinder-volume[122554]: WARNING cinder.keymgr.conf_key_mgr [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:39:39.913019 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_db.sqlalchemy.engines [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:39:39.917869 ncdv-master-1 cinder-volume[122554]: INFO cinder.rpc [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jan 15 20:39:39.922640 ncdv-master-1 cinder-volume[122554]: INFO cinder.rpc [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Jan 15 20:39:39.923352 ncdv-master-1 cinder-volume[122554]: WARNING stevedore.named [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:39:39.923820 ncdv-master-1 cinder-volume[122554]: WARNING castellan.key_manager [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:39:39.925748 ncdv-master-1 cinder-volume[122554]: INFO cinder.volume.manager [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jan 15 20:39:39.933401 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_db.sqlalchemy.engines [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:39:39.958785 ncdv-master-1 cinder-volume[122554]: INFO oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Starting 1 workers Jan 15 20:39:39.963905 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Started child 122725 {{(pid=122554) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jan 15 20:39:39.965271 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Full set of CONF: {{(pid=122554) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jan 15 20:39:39.965782 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ******************************************************************************** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 15 20:39:39.966222 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] Configuration options gathered from: {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 15 20:39:39.966580 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 15 20:39:39.967182 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 15 20:39:39.967466 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ================================================================================ {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 15 20:39:39.968179 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] allow_availability_zone_fallback = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.968609 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] allow_compression_on_image_upload = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.969128 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] allowed_direct_url_schemes = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.969516 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] api_rate_limit = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.969976 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] auth_strategy = keystone {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.970578 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] az_cache_duration = 3600 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.971116 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_availability_zone = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.971594 ncdv-master-1 cinder-volume[122725]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Jan 15 20:39:39.976387 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_host = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.976961 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.977599 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_stats_polling_interval = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.978141 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backup_api_class = cinder.backup.api.API {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.978676 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.979231 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backup_name_template = backup-%s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.979787 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backup_use_same_host = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.980312 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backup_use_temp_snapshot = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.980857 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] chap_password = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.981378 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] chap_username = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.981918 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.985439 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_internal_tenant_project_id = c028267a87b54c0c8cac54caaf0e08da {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.985966 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_internal_tenant_user_id = 2936309c4f4047e1b1ffe956cf428ff0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.986456 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cloned_volume_same_az = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.986905 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cluster = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.987450 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] compression_format = gzip {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.987962 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] compute_api_class = cinder.compute.nova.API {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.988494 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] config_dir = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.989851 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.992193 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] config_source = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.992816 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.993382 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] control_exchange = openstack {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.994028 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] debug = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.994616 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] default_availability_zone = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.995200 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] default_group_type = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.995924 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.997970 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] default_volume_type = ceph {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.998805 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] driver_client_cert = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:39.999520 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] driver_client_cert_key = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.000304 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] driver_data_namespace = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.001099 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] driver_ssl_cert_path = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.001768 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] driver_ssl_cert_verify = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.002409 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] driver_use_ssl = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.003365 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] enable_force_upload = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.003860 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] enable_new_services = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.004694 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] enable_unsupported_driver = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.005588 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] enabled_backends = ['ceph'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.006048 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] enforce_multipath_for_image_xfer = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.006449 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Starting volume driver RBDDriver (1.2.0) Jan 15 20:39:40.006572 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] filter_function = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.007037 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_api_insecure = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.007517 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_api_servers = ['http://10.222.0.46/image'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.008067 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_api_ssl_compression = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.008552 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_ca_certificates_file = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.009092 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_catalog_info = image:glance:publicURL {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.009223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.009804 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.010638 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.011218 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.011817 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_num_retries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.012375 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] glance_request_timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.012966 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] goodness_function = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.013536 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] graceful_shutdown_timeout = 5 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.014107 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] group_api_class = cinder.group.api.API {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.015298 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] host = ncdv-master-1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.015886 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iet_conf = /etc/iet/ietd.conf {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.016536 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_compress_on_upload = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.017302 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_conversion_address_space_limit = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.018107 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_conversion_cpu_limit = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.018780 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.019248 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_upload_use_cinder_backend = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.019997 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_upload_use_internal_tenant = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.020734 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_volume_cache_enabled = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.021315 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_volume_cache_max_count = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.021876 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] image_volume_cache_max_size_gb = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.022450 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] init_host_max_objects_retrieval = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.023061 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] instance_format = [instance: %(uuid)s] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.023631 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.024215 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iscsi_iotype = fileio {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.025116 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iscsi_secondary_ip_addresses = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.025828 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iscsi_target_flags = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.026394 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iscsi_write_cache = on {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.027001 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iser_helper = tgtadm {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.027975 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iser_ip_address = 10.222.0.46 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.028572 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iser_port = 3260 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.029598 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.030209 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_config_append = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.030798 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.031255 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_dir = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.031716 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_file = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.032108 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_options = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.032762 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_rotate_interval = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.033263 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_rotate_interval_type = days {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.033815 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] log_rotation_type = none {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.034295 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.034850 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.036151 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.036750 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.037287 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.037894 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] max_age = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.038477 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] max_logfile_count = 30 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.039020 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] max_logfile_size_mb = 200 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.039414 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] max_over_subscription_ratio = 20.0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.039881 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] message_reap_interval = 86400 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.040288 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] message_ttl = 2592000 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.040780 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] migration_create_volume_timeout_secs = 300 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.041215 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] monkey_patch = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.041631 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] monkey_patch_modules = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.041993 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] my_ip = 10.222.0.46 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.042517 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] no_snapshot_gb_quota = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.042988 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] num_iser_scan_tries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.043475 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] num_shell_tries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.044127 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] num_volume_device_scan_tries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.044555 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] nvmet_ns_id = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.045181 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] nvmet_port_id = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.046593 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_max_limit = 1000 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.047078 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_volume_ext_list = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.047583 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.048155 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_volume_listen = 0.0.0.0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.048737 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_volume_listen_port = 8776 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.049875 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_volume_use_ssl = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.050423 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] osapi_volume_workers = 2 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.050966 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] per_volume_size_limit = -1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.052557 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] periodic_fuzzy_delay = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.053513 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] periodic_interval = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.054633 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] public_endpoint = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.055335 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] publish_errors = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.055995 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_backup_gigabytes = 1000 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.056563 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_backups = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.057549 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_consistencygroups = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.058130 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.058651 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_gigabytes = 1000 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.059179 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_groups = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.059748 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_snapshots = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.060709 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] quota_volumes = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.061307 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] rate_limit_burst = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.061915 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] rate_limit_except_level = CRITICAL {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.062525 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] rate_limit_interval = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.063131 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] reinit_driver_count = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.063744 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] replication_device = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.064235 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.064487 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] report_discard_supported = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.065048 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] report_interval = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.065837 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] reservation_clean_interval = 86400 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.066288 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] reservation_expire = 86400 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.066854 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] reserved_percentage = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.067541 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.068078 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.068620 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] rpc_response_timeout = 120 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.069190 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] run_external_periodic_tasks = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.069700 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.070212 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] scst_target_driver = iscsi {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.070711 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] scst_target_iqn_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.071173 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_down_time = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.071691 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] snapshot_name_template = snapshot-%s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.072193 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] snapshot_same_host = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.072684 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] split_loggers = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.073199 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] state_path = /opt/stack/data/cinder {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.073715 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] storage_availability_zone = nova {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.074211 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] storage_protocol = iscsi {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.074731 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] syslog_log_facility = LOG_USER {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.075260 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] target_helper = lioadm {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.075977 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] target_ip_address = 10.222.0.46 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.077989 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] target_port = 3260 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.078530 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.079215 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] target_protocol = iscsi {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.079728 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] trace_flags = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.080114 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] transfer_api_class = cinder.transfer.api.API {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.080475 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] transport_url = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.081030 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] until_refresh = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.081564 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_chap_auth = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.082070 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_default_quota_class = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.082637 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_eventlog = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.084615 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_journal = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.085040 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_json = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.085433 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_multipath_for_image_xfer = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_stderr = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] use_syslog = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] verify_glance_signatures = enabled {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_api_class = cinder.volume.api.API {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_backend_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_clear = zero {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.092316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_clear_ionice = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093016 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_clear_size = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093016 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093016 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_copy_bps_limit = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093016 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_dd_blocksize = 1M {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093016 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093016 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_name_template = volume-%s {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093366 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_service_inithost_offload = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093366 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volume_usage_audit_period = month {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093366 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093366 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] watch_log_file = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.093652 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] zoning_mode = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 15 20:39:40.094821 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.095993 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.096560 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.enforce_new_defaults = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.097183 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.enforce_scope = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.098569 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.policy_default_rule = default {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.099302 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.099860 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.policy_file = policy.yaml {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.100440 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.101137 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.101626 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.102116 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.102654 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.103227 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_concurrency.disable_process_locking = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.103752 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.104331 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.admin_password = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.104884 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.105382 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.admin_token = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.105999 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.admin_user = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.106517 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_admin_prefix = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.107049 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.107334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.107706 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_port = 35357 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.108238 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_protocol = https {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.108948 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_section = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.109473 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_type = password {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.109973 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_uri = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.110469 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.auth_version = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.111001 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.cache = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.111499 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.111997 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.112495 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.delay_auth_decision = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.113056 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.113676 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.http_connect_timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.114262 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.114783 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.identity_uri = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.115283 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.include_service_catalog = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.115790 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.insecure = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.116675 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.interface = public {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.117195 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.117701 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.118206 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.118800 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.119376 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.120279 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.120279 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.120579 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.121185 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.121649 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.122030 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.region_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.122609 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.122967 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.service_token_roles_required = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.123311 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.service_type = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.123754 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.token_cache_time = 300 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.124333 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.124812 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.backend = dogpile.cache.null {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.125341 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.backend_argument = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.125723 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.config_prefix = cache.oslo {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.126090 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.debug_cache_backend = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.127206 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.enabled = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.127598 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.expiration_time = 600 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.128800 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_dead_retry = 300 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.128800 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.128800 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.129091 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_pool_maxsize = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.130010 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.130401 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.130848 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.memcache_socket_timeout = 1.0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.131190 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.proxies = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.131561 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.tls_allowed_ciphers = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.131907 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.tls_cafile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.132243 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.tls_certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.132599 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.tls_enabled = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.133028 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cache.tls_keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.133568 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] coordination.backend_url = etcd3+http://10.222.0.46:2379 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.134333 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.backend = sqlalchemy {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.134650 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.connection = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.135037 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.connection_debug = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.135406 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.connection_parameters = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.135755 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.connection_recycle_time = 3600 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.136261 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.connection_trace = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.136829 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.db_inc_retry_interval = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.137494 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.db_max_retries = 20 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.137990 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.db_max_retry_interval = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.138475 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.db_retry_interval = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.138838 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.max_overflow = 50 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.139188 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.max_pool_size = 5 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.139540 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.max_retries = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.139902 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.mysql_enable_ndb = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.140257 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.140605 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.pool_timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.141003 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.retry_interval = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.141508 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.slave_connection = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.142001 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.sqlite_synchronous = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.142502 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] database.use_db_reconnect = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.143049 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.143564 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.143925 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.144301 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.144643 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.145727 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.connection_string = messaging:// {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.146057 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.enabled = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.146568 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.es_doc_type = notification {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.147069 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.es_scroll_size = 10000 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.147720 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.es_scroll_time = 2m {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.148081 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.filter_error_trace = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.148439 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.hmac_keys = SECRET_KEY {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.148794 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.sentinel_service_name = mymaster {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.149195 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.socket_timeout = 0.1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.149544 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] profiler.trace_sqlalchemy = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.149959 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] privsep_osbrick.capabilities = [21] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.150313 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] privsep_osbrick.group = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.150675 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] privsep_osbrick.helper_command = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.151043 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.151394 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.151734 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] privsep_osbrick.user = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.152599 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.153386 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_sys_admin.group = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.153870 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_sys_admin.helper_command = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.154392 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.154901 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.155460 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] cinder_sys_admin.user = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.155987 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.auth_section = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.156484 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.auth_type = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.157029 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.cafile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.157669 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.158186 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.collect_timing = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.158636 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.driver [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Driver hasn't implemented _init_vendor_properties() Jan 15 20:39:40.158848 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.insecure = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.159009 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.driver [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:667354f5-12ed-4ec2-a0f3-78cc2b3addc4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=122725) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Jan 15 20:39:40.159483 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.159999 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.send_service_user_token = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.160544 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.split_loggers = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.161159 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] service_user.timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.161743 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.backend_availability_zone = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.162243 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.162729 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.163220 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.chap_password = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.163708 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.chap_username = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.164199 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.164718 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.165230 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.165715 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.driver_client_cert = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.166212 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.driver_client_cert_key = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.166705 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.driver_data_namespace = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.167185 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.167825 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.168310 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.driver_use_ssl = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.168807 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.enable_deferred_deletion = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.169304 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.enable_unsupported_driver = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.169809 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.170298 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.extra_capabilities = {} {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.170766 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.filter_function = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.171238 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.goodness_function = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.171742 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.172237 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.172717 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.173236 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.173721 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.174287 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.174843 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iscsi_iotype = fileio {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.175410 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.175965 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iscsi_target_flags = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.177396 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iscsi_write_cache = on {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.178150 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iser_helper = tgtadm {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.178418 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:39:40.179049 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iser_ip_address = 10.222.0.46 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.179768 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iser_port = 3260 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.180568 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.181468 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.182347 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.183086 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.num_shell_tries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.184005 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.184961 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.185582 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.nvmet_port_id = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.186136 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.186675 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rados_connection_interval = 5 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.187208 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rados_connection_retries = 3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.187823 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_ceph_conf = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.188834 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.189417 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.189956 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.190488 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.191022 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_pool = rbd {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.191542 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_secret_uuid = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.192165 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.192690 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.rbd_user = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.193228 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.193744 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.replication_device = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.194265 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.report_discard_supported = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.194791 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.195330 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.reserved_percentage = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.195863 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.scst_target_driver = iscsi {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.196389 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.scst_target_iqn_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.196957 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.storage_protocol = iscsi {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.197512 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.198043 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.target_helper = tgtadm {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.198894 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.target_ip_address = 10.222.0.46 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.199432 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.target_port = 3260 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.199972 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.200523 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.target_protocol = iscsi {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.201080 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.trace_flags = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.201623 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.unique_fqdn_network = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.202138 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.use_chap_auth = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.202641 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.203148 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_backend_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.203712 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_clear = zero {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.204123 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_clear_ionice = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.204537 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_clear_size = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.205000 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.205539 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.206095 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.206657 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.207839 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.208560 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_reports.file_event_handler = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.209148 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.209658 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_reports.log_dir = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.211148 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.backend_availability_zone = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.211689 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.backend_host = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.212206 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.backend_native_threads_pool_size = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.212711 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.backup_use_temp_snapshot = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.213239 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.chap_password = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.213779 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.chap_username = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.214336 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.chiscsi_conf = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.214864 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.deferred_deletion_delay = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.215379 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.deferred_deletion_purge_interval = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.215891 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.driver_client_cert = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.216403 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.driver_client_cert_key = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.216521 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.db.sqlalchemy.api [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Building query based on filter {{(pid=122725) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3156}} Jan 15 20:39:40.217331 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.driver_data_namespace = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.217863 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.driver_ssl_cert_path = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.218379 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.driver_ssl_cert_verify = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.219032 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.driver_use_ssl = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.219556 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.enable_deferred_deletion = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.220071 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.enable_unsupported_driver = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.220596 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.221132 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.extra_capabilities = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.221660 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.filter_function = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.222175 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.goodness_function = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.222700 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iet_conf = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.223316 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.image_upload_use_cinder_backend = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.224013 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.image_upload_use_internal_tenant = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.224572 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.image_volume_cache_enabled = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.225120 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.image_volume_cache_max_count = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.225657 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.226175 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iscsi_iotype = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.226699 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.227217 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iscsi_target_flags = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.227728 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iscsi_write_cache = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.228259 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iser_helper = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.228960 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iser_ip_address = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.229494 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iser_port = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.230019 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.iser_target_prefix = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.230536 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.max_over_subscription_ratio = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.231049 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.num_iser_scan_tries = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.231579 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.num_shell_tries = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.232102 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.num_volume_device_scan_tries = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.232611 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.nvmet_ns_id = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.233138 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.nvmet_port_id = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.233685 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rados_connect_timeout = -1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.234085 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rados_connection_interval = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.234512 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rados_connection_retries = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.234947 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.235358 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_cluster_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.235776 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.236216 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.236636 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_max_clone_depth = 5 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.237223 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_pool = volumes {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.237764 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_secret_uuid = 53efa32e-6408-4d4a-b019-3d2f51bdcfea {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.238280 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_store_chunk_size = 4 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.238393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=122725) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Jan 15 20:39:40.239771 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.rbd_user = cinder {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.240432 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.replication_connect_timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.240987 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.replication_device = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.241509 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.report_discard_supported = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.242050 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.report_dynamic_total_capacity = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.242574 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.reserved_percentage = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.243071 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.scst_target_driver = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.243581 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.scst_target_iqn_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.244087 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.storage_protocol = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.244587 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.245225 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.target_helper = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.245753 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.target_ip_address = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.246273 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.target_port = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.246776 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.target_prefix = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.247284 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.target_protocol = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.247804 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.trace_flags = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.247916 ncdv-master-1 cinder-volume[122725]: INFO cinder.keymgr.migration [None req-eb7c1bfd-fb99-48f9-8031-4846259c3c74 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jan 15 20:39:40.248479 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.unique_fqdn_network = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.249046 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.use_chap_auth = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.249697 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.use_multipath_for_image_xfer = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.250220 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_backend_name = ceph {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.250757 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_clear = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.251327 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_clear_ionice = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.251851 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_clear_size = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.252364 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.252901 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_copy_bps_limit = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.253426 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_dd_blocksize = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.253957 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.254574 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ceph.volumes_dir = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.255466 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.256036 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.256584 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.257145 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.257294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.257763 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.258173 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.258606 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.259015 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.259575 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.259989 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.260447 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.260899 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.261367 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.261764 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.262192 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.262625 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.263034 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.263446 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.263851 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.264272 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.264681 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.265993 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.ssl = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.265993 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.265993 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.266500 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.266954 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_rabbit.ssl_version = {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.267366 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_notifications.driver = [] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.267839 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_notifications.retry = -1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.268357 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.268798 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] oslo_messaging_notifications.transport_url = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.269267 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.270458 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] key_manager.fixed_key = **** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.271469 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.271859 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.barbican_api_version = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.272313 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.barbican_endpoint = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.273136 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.barbican_endpoint_type = public {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.273136 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.barbican_region_name = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.273643 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.cafile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.274746 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.274746 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.collect_timing = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.275020 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.insecure = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.275372 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.275868 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.number_of_retries = 60 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.276415 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.retry_delay = 1 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.277313 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.send_service_user_token = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.277882 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.split_loggers = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.278294 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.278739 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.verify_ssl = True {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.279159 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican.verify_ssl_path = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.279612 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.auth_section = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.280184 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.auth_type = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.280622 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.cafile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.281135 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.281576 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.collect_timing = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.282017 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.insecure = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.282551 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.283110 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.split_loggers = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.283638 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] barbican_service_user.timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.284974 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.approle_role_id = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.285431 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.approle_secret_id = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.286161 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.cafile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.286513 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.certfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.286962 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.collect_timing = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.287378 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.insecure = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.288053 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.keyfile = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.288475 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.kv_mountpoint = secret {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.289018 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.kv_version = 2 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.289483 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.namespace = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.289891 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.root_token_id = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.290479 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.split_loggers = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.290932 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.ssl_ca_crt_file = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.291276 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.timeout = None {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.291621 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.use_ssl = False {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.291982 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 15 20:39:40.292265 ncdv-master-1 cinder-volume[122554]: DEBUG oslo_service.service [None req-37891800-65f1-44d7-a793-2a7da84b6d19 None None] ******************************************************************************** {{(pid=122554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 15 20:39:40.300101 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.331904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:39:40.365967 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Driver initialization completed successfully. Jan 15 20:39:40.378768 ncdv-master-1 cinder-volume[122725]: INFO cinder.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Initiating service 3 cleanup Jan 15 20:39:40.384965 ncdv-master-1 cinder-volume[122725]: INFO cinder.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Service 3 cleanup completed. Jan 15 20:39:40.385293 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.service [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Creating RPC server for service cinder-volume {{(pid=122725) start /opt/stack/cinder/cinder/service.py:231}} Jan 15 20:39:40.392038 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.service [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=122725) start /opt/stack/cinder/cinder/service.py:237}} Jan 15 20:39:40.453648 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jan 15 20:39:40.454574 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.482999 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:39:40.533345 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4ea3dab6-3a44-4b7c-a8ad-40b844920b6f None None] Driver post RPC initialization completed successfully. Jan 15 20:40:40.535374 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:40:40.536145 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:40:40.560938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:40:40.587197 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:41:40.539326 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:41:40.540104 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:41:40.562440 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:41:40.586701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:43:40.541888 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:43:40.542697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:43:40.564186 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:43:40.585805 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:44:40.541026 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:44:40.541675 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:44:40.563951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:44:40.586006 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:45:40.545043 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:45:40.545668 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:45:40.566015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:45:40.588094 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:46:40.543039 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:46:40.543712 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:46:40.564888 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:46:40.587111 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:47:40.542220 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:47:40.542954 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:47:40.566673 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:47:40.590965 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:48:40.547500 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:48:40.548917 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:48:40.648795 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:48:40.793376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:49:40.549234 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:49:40.550528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:49:40.622460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:49:40.723297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:50:40.549685 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:50:40.551281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:50:40.631401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:50:40.710181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:51:29.694482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:51:29.703820 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:51:29.708498 ncdv-master-1 cinder-volume[122725]: INFO cinder.rpc [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jan 15 20:51:29.714003 ncdv-master-1 cinder-volume[122725]: INFO cinder.rpc [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Jan 15 20:51:29.715151 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:51:29.715697 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:51:29.759939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Flow 'volume_create_manager' (f4b9ba85-f449-4cd0-9c67-922e57dfd0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:51:29.766215 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf0cf20-fb9c-4add-a6a5-22a71ea27296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:51:29.775941 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:51:29.824690 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf0cf20-fb9c-4add-a6a5-22a71ea27296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-2085223870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=53534861-c45e-4186-a9c4-9bd3a661cb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ede5f7e26d484fb1c6f18819a90e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:51:30Z,use_quota=True,user_id='a15f22e0573c4433b35a46c5245e30f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:51:29.832570 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02cd37d-1553-4276-b26e-08bb4a62eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:51:29.843597 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02cd37d-1553-4276-b26e-08bb4a62eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:51:29.848900 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed804d1-e136-4222-8279-634794446f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:51:29.853033 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed804d1-e136-4222-8279-634794446f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53534861-c45e-4186-a9c4-9bd3a661cb59', 'volume_name': 'volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:51:29.860043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1a4ede-f2fb-430a-b4cd-d1e3efba0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:51:29.866162 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1a4ede-f2fb-430a-b4cd-d1e3efba0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:51:29.871797 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403d5c2e-b716-4393-8205-44a923daae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:51:29.873310 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume 53534861-c45e-4186-a9c4-9bd3a661cb59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'volume_size': 1} Jan 15 20:51:29.873977 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] creating volume 'volume-53534861-c45e-4186-a9c4-9bd3a661cb59' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:51:29.875296 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:51:30.088832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:51:30.089624 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:51:30.094645 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403d5c2e-b716-4393-8205-44a923daae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:51:30.101648 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f56001-e848-4b80-8a2c-e046980cac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:51:30.119473 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-53534861-c45e-4186-a9c4-9bd3a661cb59 (53534861-c45e-4186-a9c4-9bd3a661cb59): created successfully Jan 15 20:51:30.123488 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f56001-e848-4b80-8a2c-e046980cac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:51:30.129820 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Flow 'volume_create_manager' (f4b9ba85-f449-4cd0-9c67-922e57dfd0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:51:30.155494 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b5cfb78c-fed1-4906-9e77-ff4f0f41b86b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Created volume successfully. Jan 15 20:51:31.450996 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-e6852b8f-c054-4b91-a593-0d34e1772d26 req-7b61c4d1-5e43-46d6-8caa-9ac41d1402df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:51:32.233137 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-e6852b8f-c054-4b91-a593-0d34e1772d26 req-7b61c4d1-5e43-46d6-8caa-9ac41d1402df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.782s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:51:32.234039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e6852b8f-c054-4b91-a593-0d34e1772d26 req-7b61c4d1-5e43-46d6-8caa-9ac41d1402df tempest-LiveAutoBlockMigrationV225Test-561034217 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '53534861-c45e-4186-a9c4-9bd3a661cb59', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:51:32.323666 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e6852b8f-c054-4b91-a593-0d34e1772d26 req-7b61c4d1-5e43-46d6-8caa-9ac41d1402df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Connection info returned from driver {'name': 'volumes/volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '53534861-c45e-4186-a9c4-9bd3a661cb59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b5dd275-4079-4dde-babe-43fd128f27cd'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:51:32.445764 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e6852b8f-c054-4b91-a593-0d34e1772d26 req-7b61c4d1-5e43-46d6-8caa-9ac41d1402df tempest-LiveAutoBlockMigrationV225Test-561034217 None] attachment_update completed successfully. Jan 15 20:51:40.547690 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:51:40.549378 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:51:40.588101 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:51:40.620252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:51:41.484054 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-4deeff88-70f8-4458-af16-c9d804f20204 tempest-LiveAutoBlockMigrationV225Test-75508502 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:51:42.466823 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-4deeff88-70f8-4458-af16-c9d804f20204 tempest-LiveAutoBlockMigrationV225Test-75508502 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.982s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:51:42.468240 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-4deeff88-70f8-4458-af16-c9d804f20204 tempest-LiveAutoBlockMigrationV225Test-75508502 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '53534861-c45e-4186-a9c4-9bd3a661cb59', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:51:42.515121 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-4deeff88-70f8-4458-af16-c9d804f20204 tempest-LiveAutoBlockMigrationV225Test-75508502 None] Connection info returned from driver {'name': 'volumes/volume-53534861-c45e-4186-a9c4-9bd3a661cb59', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '53534861-c45e-4186-a9c4-9bd3a661cb59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '61972766-d268-4787-9219-b038e0ebca2f'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:51:42.601177 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-4deeff88-70f8-4458-af16-c9d804f20204 tempest-LiveAutoBlockMigrationV225Test-75508502 None] attachment_update completed successfully. Jan 15 20:51:57.107763 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-2cf85a2f-cb60-43f9-9a6a-fa20dd82ba50 tempest-LiveAutoBlockMigrationV225Test-75508502 None] Terminate volume connection completed successfully. Jan 15 20:51:57.110384 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-875be608-c5cb-44e2-a05c-bfc660e6dde1 req-2cf85a2f-cb60-43f9-9a6a-fa20dd82ba50 tempest-LiveAutoBlockMigrationV225Test-75508502 None] Deleting attachment 5b5dd275-4079-4dde-babe-43fd128f27cd. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:52:05.893359 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 req-157b18a3-c339-4fb8-8738-1565ec0333be tempest-LiveAutoBlockMigrationV225Test-561034217 None] Terminate volume connection completed successfully. Jan 15 20:52:05.895300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-5e0edd2a-2305-45bd-9dfd-a80adf38db65 req-157b18a3-c339-4fb8-8738-1565ec0333be tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deleting attachment 61972766-d268-4787-9219-b038e0ebca2f. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:52:08.186403 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:52:08.190244 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:52:08.190737 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:52:08.213553 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Flow 'volume_create_manager' (44dde844-785f-43fb-82fb-fd29508b4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:52:08.220447 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157a8965-a571-4a92-94b2-463089c1aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:08.228714 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:52:08.244440 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157a8965-a571-4a92-94b2-463089c1aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-192477016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=de865fb1-204c-482c-a650-62332e1f854e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ede5f7e26d484fb1c6f18819a90e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:52:08Z,use_quota=True,user_id='a15f22e0573c4433b35a46c5245e30f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:08.250075 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce671835-4c65-408b-9d92-bb6821d223fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:08.255694 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce671835-4c65-408b-9d92-bb6821d223fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:08.262002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e8e07-d55c-4070-8be4-4cd7c86357d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:08.393252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6e8e07-d55c-4070-8be4-4cd7c86357d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de865fb1-204c-482c-a650-62332e1f854e', 'volume_name': 'volume-de865fb1-204c-482c-a650-62332e1f854e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:08.401303 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a1028b-ce9b-4ceb-8aa8-a56bc2fdabb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:08.405744 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a1028b-ce9b-4ceb-8aa8-a56bc2fdabb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:08.412144 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad4ad66-6561-4e79-a1de-c4e60ecc5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:08.413645 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume de865fb1-204c-482c-a650-62332e1f854e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de865fb1-204c-482c-a650-62332e1f854e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 20:52:08.414492 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Cloning de865fb1-204c-482c-a650-62332e1f854e from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 20:52:08.425017 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:52:08.438714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Preparing cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} Jan 15 20:52:08.440094 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 20:52:23.601438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph, size 616.00 MB, duration 15.15 sec {{(pid=122725) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Jan 15 20:52:23.602455 ncdv-master-1 cinder-volume[122725]: INFO cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Image download 616.00 MB at 40.65 MB/s Jan 15 20:52:23.660329 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:23.832114 ncdv-master-1 sudo[133002]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph Jan 15 20:52:23.833132 ncdv-master-1 sudo[133002]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 15 20:52:25.548043 ncdv-master-1 sudo[133002]: pam_unix(sudo:session): session closed for user root Jan 15 20:52:25.550419 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph" returned: 0 in 1.890s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:25.557388 ncdv-master-1 cinder-volume[122725]: WARNING py.warnings [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 15 20:52:25.557388 ncdv-master-1 cinder-volume[122725]: debtcollector.deprecate( Jan 15 20:52:25.557388 ncdv-master-1 cinder-volume[122725]: Jan 15 20:52:25.558321 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Temporary image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 is fetched for user a15f22e0573c4433b35a46c5245e30f9. {{(pid=122725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Jan 15 20:52:25.649220 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:25.783271 ncdv-master-1 sudo[133011]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph Jan 15 20:52:25.784202 ncdv-master-1 sudo[133011]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 15 20:52:27.611263 ncdv-master-1 sudo[133011]: pam_unix(sudo:session): session closed for user root Jan 15 20:52:27.624249 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph" returned: 0 in 1.975s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:27.625206 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] creating volume 'volume-de865fb1-204c-482c-a650-62332e1f854e' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:52:27.626965 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:52:27.809582 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:52:27.810748 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:52:27.859625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Attempting download of 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 ((None, None)) to volume de865fb1-204c-482c-a650-62332e1f854e. {{(pid=122725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Jan 15 20:52:27.945608 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_g69kdp14 {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:28.288345 ncdv-master-1 sudo[133041]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_g69kdp14 Jan 15 20:52:28.289743 ncdv-master-1 sudo[133041]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 15 20:52:30.329041 ncdv-master-1 sudo[133041]: pam_unix(sudo:session): session closed for user root Jan 15 20:52:30.331468 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_g69kdp14" returned: 0 in 2.385s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:30.333559 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:30.490392 ncdv-master-1 sudo[133057]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph Jan 15 20:52:30.492230 ncdv-master-1 sudo[133057]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 15 20:52:32.357041 ncdv-master-1 sudo[133057]: pam_unix(sudo:session): session closed for user root Jan 15 20:52:32.359861 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph" returned: 0 in 2.026s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:32.361368 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 was vhdx, converting to raw {{(pid=122725) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Jan 15 20:52:32.362803 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpnh5xkoxf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:32.388206 ncdv-master-1 sudo[133073]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpnh5xkoxf Jan 15 20:52:32.389659 ncdv-master-1 sudo[133073]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 15 20:52:35.373825 ncdv-master-1 sudo[133073]: pam_unix(sudo:session): session closed for user root Jan 15 20:52:35.376784 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpnh5xkoxf" returned: 0 in 3.014s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:35.380118 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:35.571099 ncdv-master-1 sudo[133100]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph Jan 15 20:52:35.573234 ncdv-master-1 sudo[133100]: pam_unix(sudo:session): session opened for user root by (uid=0) Jan 15 20:52:38.387450 ncdv-master-1 sudo[133100]: pam_unix(sudo:session): session closed for user root Jan 15 20:52:38.389968 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph" returned: 0 in 3.010s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:38.391460 ncdv-master-1 cinder-volume[122725]: WARNING py.warnings [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jan 15 20:52:38.391460 ncdv-master-1 cinder-volume[122725]: debtcollector.deprecate( Jan 15 20:52:38.391460 ncdv-master-1 cinder-volume[122725]: Jan 15 20:52:38.392535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815_negrohqbncdv-master-1@ceph, size 700.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/conversion/tmpnh5xkoxf {{(pid=122725) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Jan 15 20:52:38.393444 ncdv-master-1 cinder-volume[122725]: INFO cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Converted 700.00 MB image at 232.02 MB/s Jan 15 20:52:38.395138 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:52:38.540751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:52:38.548600 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:52:38.578068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] deleting rbd volume volume-de865fb1-204c-482c-a650-62332e1f854e {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:52:39.037224 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpnh5xkoxf volume-de865fb1-204c-482c-a650-62332e1f854e --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:40.559064 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:52:40.560644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:52:40.675564 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:52:40.793814 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:52:45.083181 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpnh5xkoxf volume-de865fb1-204c-482c-a650-62332e1f854e --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.046s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:45.220377 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:52:45.385508 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:52:45.386238 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:52:45.386885 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Downloaded image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 ((None, None)) to volume de865fb1-204c-482c-a650-62332e1f854e successfully. {{(pid=122725) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Jan 15 20:52:45.433847 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Temporary image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 for user a15f22e0573c4433b35a46c5245e30f9 is deleted. {{(pid=122725) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Jan 15 20:52:45.494233 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 15 20:52:45.495146 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 15 20:52:45.602522 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Created reservations ['8dc3e764-f809-405f-b19b-3ab652096252', 'b37c33d1-1d72-4c30-b105-63922134a368', 'bae75ded-64f8-4c4a-b7bf-6b0fc794c497', '1a59d28b-5633-4cf1-a825-217b0514530b'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:52:45.621770 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Creating image volume entry: {'replication_extended_status': None, 'volume_type_id': 'c8306164-c84c-4922-ad4f-280887ec0a56', 'availability_zone': 'nova', 'display_description': None, 'host': 'ncdv-master-1@ceph#ceph', 'deleted_at': None, 'metadata': {}, 'bootable': False, 'volume_admin_metadata': [], 'updated_at': datetime.datetime(2022, 1, 15, 20, 52, 8, tzinfo=datetime.timezone.utc), 'provider_location': None, 'provider_geometry': None, 'replication_status': None, 'provider_auth': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'group_id': None, 'volume_metadata': [], 'project_id': 'c028267a87b54c0c8cac54caaf0e08da', 'scheduled_at': datetime.datetime(2022, 1, 15, 20, 52, 8, tzinfo=datetime.timezone.utc), 'ec2_id': None, 'launched_at': None, 'terminated_at': None, 'previous_status': None, 'cluster_name': None, 'service_uuid': None, 'replication_driver_data': None, 'deleted': False, 'provider_id': None, 'size': 1, 'shared_targets': True, 'multiattach': False, 'encryption_key_id': None, 'user_id': 'a15f22e0573c4433b35a46c5245e30f9', 'created_at': datetime.datetime(2022, 1, 15, 20, 52, 8, tzinfo=datetime.timezone.utc), 'consistencygroup_id': None, 'display_name': 'image-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'de865fb1-204c-482c-a650-62332e1f854e'}. {{(pid=122725) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Jan 15 20:52:45.723262 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume reschedule parameters: False retry: None {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:52:45.735949 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:52:45.742461 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:52:45.794455 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Flow 'volume_create_manager' (a40fc946-1d9d-4667-86c6-bc16ea09588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:52:45.807479 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305988b7-f280-4c05-9b63-8e8af8ef1d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:45.819488 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:52:45.840276 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305988b7-f280-4c05-9b63-8e8af8ef1d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='image-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3796de7d-2057-45ab-912d-cdbf04b3cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c028267a87b54c0c8cac54caaf0e08da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=de865fb1-204c-482c-a650-62332e1f854e,status='creating',terminated_at=None,updated_at=2022-01-15T20:52:08Z,use_quota=True,user_id='a15f22e0573c4433b35a46c5245e30f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:45.850671 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23463589-fddc-4c30-8ec2-d49b1877f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:45.857461 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23463589-fddc-4c30-8ec2-d49b1877f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:45.864528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82e0223-8434-4568-98b4-89aff2a43e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:45.884047 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82e0223-8434-4568-98b4-89aff2a43e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'volume_name': 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'volume_size': 1, 'source_volid': 'de865fb1-204c-482c-a650-62332e1f854e', 'source_volstatus': 'downloading'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:45.889915 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0819cd-789f-48bc-9cba-3012b8a4f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:45.895133 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0819cd-789f-48bc-9cba-3012b8a4f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:45.900823 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7650bf45-5ba9-4d20-a59c-6fc41248c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:45.902072 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'volume_size': 1, 'source_volid': 'de865fb1-204c-482c-a650-62332e1f854e', 'source_volstatus': 'downloading'} Jan 15 20:52:45.914762 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:52:46.006657 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] creating snapshot='volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 20:52:47.023436 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] cloning 'volume-de865fb1-204c-482c-a650-62332e1f854e@volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf.clone_snap' to 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 20:52:47.225651 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:52:47.226785 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:52:47.227758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:52:47.270215 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 20:52:47.275226 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7650bf45-5ba9-4d20-a59c-6fc41248c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'volume_size': 1, 'source_volid': 'de865fb1-204c-482c-a650-62332e1f854e', 'source_volstatus': 'downloading'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:47.291235 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16bbfc4-51c7-4006-8a70-f57aaf1612c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:47.328748 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf (3796de7d-2057-45ab-912d-cdbf04b3cdcf): created successfully Jan 15 20:52:47.347299 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16bbfc4-51c7-4006-8a70-f57aaf1612c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:47.365597 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Flow 'volume_create_manager' (a40fc946-1d9d-4667-86c6-bc16ea09588a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:52:47.404929 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Created volume successfully. Jan 15 20:52:47.513000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Creating new image-volume cache entry for image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on ncdv-master-1@ceph#ceph {{(pid=122725) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jan 15 20:52:47.530036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] New image-volume cache entry created: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 52, 47, 516747)}. {{(pid=122725) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jan 15 20:52:47.538265 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 39.113s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:52:47.540441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Marking volume de865fb1-204c-482c-a650-62332e1f854e as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 20:52:47.560813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to de865fb1-204c-482c-a650-62332e1f854e. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 20:52:47.562054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Creating volume glance metadata for volume de865fb1-204c-482c-a650-62332e1f854e backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 20:52:47.717724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad4ad66-6561-4e79-a1de-c4e60ecc5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de865fb1-204c-482c-a650-62332e1f854e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:47.723638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3ec9a1-0d22-40ad-8324-2c0927e11f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:52:47.734077 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e (de865fb1-204c-482c-a650-62332e1f854e): created successfully Jan 15 20:52:47.744148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3ec9a1-0d22-40ad-8324-2c0927e11f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:52:47.750088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Flow 'volume_create_manager' (44dde844-785f-43fb-82fb-fd29508b4155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:52:47.759901 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f50237af-d878-4f8a-809d-07991e5c39df tempest-LiveAutoBlockMigrationV225Test-561034217 None] Created volume successfully. Jan 15 20:52:53.701721 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-4674d010-a637-4b6f-84f3-2239f1a19f63 req-f67453e2-15cd-46ac-af27-a6945b068f6b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:52:55.189333 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-4674d010-a637-4b6f-84f3-2239f1a19f63 req-f67453e2-15cd-46ac-af27-a6945b068f6b tempest-LiveAutoBlockMigrationV225Test-561034217 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.488s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:52:55.190105 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-4674d010-a637-4b6f-84f3-2239f1a19f63 req-f67453e2-15cd-46ac-af27-a6945b068f6b tempest-LiveAutoBlockMigrationV225Test-561034217 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-de865fb1-204c-482c-a650-62332e1f854e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'de865fb1-204c-482c-a650-62332e1f854e', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:52:55.226465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-4674d010-a637-4b6f-84f3-2239f1a19f63 req-f67453e2-15cd-46ac-af27-a6945b068f6b tempest-LiveAutoBlockMigrationV225Test-561034217 None] Connection info returned from driver {'name': 'volumes/volume-de865fb1-204c-482c-a650-62332e1f854e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'de865fb1-204c-482c-a650-62332e1f854e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '96ea7917-763e-4a97-a03b-28db5cc03166'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:52:55.306321 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-4674d010-a637-4b6f-84f3-2239f1a19f63 req-f67453e2-15cd-46ac-af27-a6945b068f6b tempest-LiveAutoBlockMigrationV225Test-561034217 None] attachment_update completed successfully. Jan 15 20:53:21.779992 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-47fd2627-d314-4875-8ddd-0bcdbbea7bae tempest-LiveAutoBlockMigrationV225Test-75508502 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:53:23.612239 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-47fd2627-d314-4875-8ddd-0bcdbbea7bae tempest-LiveAutoBlockMigrationV225Test-75508502 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.838s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:53:23.612860 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-47fd2627-d314-4875-8ddd-0bcdbbea7bae tempest-LiveAutoBlockMigrationV225Test-75508502 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-de865fb1-204c-482c-a650-62332e1f854e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'de865fb1-204c-482c-a650-62332e1f854e', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:53:23.687726 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-47fd2627-d314-4875-8ddd-0bcdbbea7bae tempest-LiveAutoBlockMigrationV225Test-75508502 None] Connection info returned from driver {'name': 'volumes/volume-de865fb1-204c-482c-a650-62332e1f854e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'de865fb1-204c-482c-a650-62332e1f854e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d1a0ffc-d70e-44c7-9347-f232c855cfab'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:53:23.786323 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-47fd2627-d314-4875-8ddd-0bcdbbea7bae tempest-LiveAutoBlockMigrationV225Test-75508502 None] attachment_update completed successfully. Jan 15 20:53:32.537336 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:53:32.574033 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:53:32.574949 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:53:32.675357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Flow 'volume_create_manager' (d6a043e6-5c6c-45e5-802f-60abe473595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:53:32.706408 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95258bfe-cc51-48d0-8f92-27b18eda044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:32.749330 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:53:32.789967 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95258bfe-cc51-48d0-8f92-27b18eda044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1987897781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2bdef2ab-ec70-41f0-8baa-f2d47689a8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f021c66112bf49f685a34c55841857bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:53:32Z,use_quota=True,user_id='68bf33c7cdd84129a5544916a7dc3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:32.803259 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590ef6a1-abf8-4834-b6cc-24b9d8e853f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:32.813218 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590ef6a1-abf8-4834-b6cc-24b9d8e853f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:32.829033 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a7a0e6-52a1-4dd2-ba25-9f94b250eed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:32.842485 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a7a0e6-52a1-4dd2-ba25-9f94b250eed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'volume_name': 'volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:32.856676 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4034bd-6ea7-447d-849e-0379445c3ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:32.868997 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4034bd-6ea7-447d-849e-0379445c3ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:32.883001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143b8f92-e651-4b77-a106-0d3b4313d89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:32.884396 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Volume 2bdef2ab-ec70-41f0-8baa-f2d47689a8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'volume_size': 1} Jan 15 20:53:32.885303 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] creating volume 'volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:53:32.889506 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:33.026036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:53:33.026617 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:53:33.033515 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143b8f92-e651-4b77-a106-0d3b4313d89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:33.061999 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d0667a-e0ef-482f-8728-615e2da17986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:33.089161 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Volume volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab (2bdef2ab-ec70-41f0-8baa-f2d47689a8ab): created successfully Jan 15 20:53:33.104310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d0667a-e0ef-482f-8728-615e2da17986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:33.135095 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Flow 'volume_create_manager' (d6a043e6-5c6c-45e5-802f-60abe473595c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:53:33.161017 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-086f34de-34c9-4e8f-a40b-668c475ec6d4 tempest-VolumesAdminNegativeTest-1682858856 None] Created volume successfully. Jan 15 20:53:35.007058 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-81d7f981-2015-4761-bf54-8523356cbd42 tempest-LiveAutoBlockMigrationV225Test-75508502 None] Terminate volume connection completed successfully. Jan 15 20:53:35.007833 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6484a0fb-955f-4719-80c3-0aa7c9b74df4 req-81d7f981-2015-4761-bf54-8523356cbd42 tempest-LiveAutoBlockMigrationV225Test-75508502 None] Deleting attachment 96ea7917-763e-4a97-a03b-28db5cc03166. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:53:36.096483 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e req-a6ac5b9e-57eb-4a75-8236-ddd1c860cec8 tempest-VolumesAdminNegativeTest-1682858856 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:53:38.668973 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e req-a6ac5b9e-57eb-4a75-8236-ddd1c860cec8 tempest-VolumesAdminNegativeTest-1682858856 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.570s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:53:38.671129 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e req-a6ac5b9e-57eb-4a75-8236-ddd1c860cec8 tempest-VolumesAdminNegativeTest-1682858856 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:53:38.724703 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e req-a6ac5b9e-57eb-4a75-8236-ddd1c860cec8 tempest-VolumesAdminNegativeTest-1682858856 None] Connection info returned from driver {'name': 'volumes/volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2bdef2ab-ec70-41f0-8baa-f2d47689a8ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0d8e9ef3-0ba3-4d58-b491-d834ee33aae9'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:53:38.894383 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-dd536ad0-bd5d-4103-93d2-aa3ceda9964e req-a6ac5b9e-57eb-4a75-8236-ddd1c860cec8 tempest-VolumesAdminNegativeTest-1682858856 None] attachment_update completed successfully. Jan 15 20:53:40.550162 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:53:40.552433 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:40.694439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:40.839988 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:53:45.183022 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-624a72f2-c7e9-4047-8cb3-9d33bb940dde req-2e6ef645-6fb2-4a55-995a-2b3ca485bbca tempest-VolumesAdminNegativeTest-1682858856 None] Terminate volume connection completed successfully. Jan 15 20:53:45.186087 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-624a72f2-c7e9-4047-8cb3-9d33bb940dde req-2e6ef645-6fb2-4a55-995a-2b3ca485bbca tempest-VolumesAdminNegativeTest-1682858856 None] Deleting attachment 0d8e9ef3-0ba3-4d58-b491-d834ee33aae9. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:53:46.477727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:53:46.487529 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:53:46.489885 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:53:46.593727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Flow 'volume_create_manager' (f0eeae65-37cf-468c-8ef0-f0bbd507efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:53:46.640622 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f50848-1c14-4b26-8b82-a291b2fc3987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:46.657853 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:53:46.695153 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f50848-1c14-4b26-8b82-a291b2fc3987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1822786182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c52db4ae-fb74-4e0e-aed1-302a359bf9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f021c66112bf49f685a34c55841857bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:53:46Z,use_quota=True,user_id='68bf33c7cdd84129a5544916a7dc3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:46.729074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a7e701-22ba-4e1f-bc75-56e054b450bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:46.754838 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a7e701-22ba-4e1f-bc75-56e054b450bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:46.772482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b1ebd0-010b-492e-b77a-17922927c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:46.801776 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b1ebd0-010b-492e-b77a-17922927c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52db4ae-fb74-4e0e-aed1-302a359bf9e1', 'volume_name': 'volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:46.815408 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96985f6f-1eb7-46ab-aa6d-5b49b2994a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:46.825476 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96985f6f-1eb7-46ab-aa6d-5b49b2994a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:46.844287 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7e3fe7-ca7b-4743-9c2f-8c9c8aa9e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:46.852983 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Volume c52db4ae-fb74-4e0e-aed1-302a359bf9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1', 'volume_size': 1} Jan 15 20:53:46.856517 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] creating volume 'volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:53:46.860245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:47.053721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:53:47.054534 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:53:47.062895 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7e3fe7-ca7b-4743-9c2f-8c9c8aa9e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:47.088641 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46325720-edd3-49a6-8f17-2f08c816e473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:53:47.128709 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Volume volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1 (c52db4ae-fb74-4e0e-aed1-302a359bf9e1): created successfully Jan 15 20:53:47.134257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46325720-edd3-49a6-8f17-2f08c816e473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:53:47.159518 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Flow 'volume_create_manager' (f0eeae65-37cf-468c-8ef0-f0bbd507efce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:53:47.190068 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-aab72116-60b8-4e70-a42f-aad2d208ae8c tempest-VolumesAdminNegativeTest-1682858856 None] Created volume successfully. Jan 15 20:53:48.513517 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] Lock "b'cinder-c52db4ae-fb74-4e0e-aed1-302a359bf9e1-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:53:48.608992 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:48.710686 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:53:48.712444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] Volume volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:53:48.731864 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] deleting rbd volume volume-c52db4ae-fb74-4e0e-aed1-302a359bf9e1 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:53:49.490982 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] Created reservations ['66877323-6a7d-4a3d-b170-2d1fe95f789c', '19fe1006-ffbc-4565-bf66-739b25fc38e3', '80780a6a-1d32-4113-acee-3068f6ae436d', '1562e101-b4ba-415c-9c15-cba4b036c54c'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:53:49.630415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:49.738512 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:49.880495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:53:49.904151 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] Deleted volume successfully. Jan 15 20:53:49.976014 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-715cbb19-67bb-4289-8e5f-4d048c09ee75 tempest-VolumesAdminNegativeTest-1682858856 None] Lock "b'cinder-c52db4ae-fb74-4e0e-aed1-302a359bf9e1-delete_volume'" released by "delete_volume" :: held 1.475s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:53:49.993129 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] Lock "b'cinder-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab-delete_volume'" acquired by "delete_volume" :: waited 0.104s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:53:50.078060 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:50.161310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:53:50.161985 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] Volume volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:53:50.174420 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] deleting rbd volume volume-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:53:50.771542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] Created reservations ['ade16123-f442-48b7-ab65-b2d8e8cd7deb', '827d8a86-5b49-4e6f-814d-55214f6dae76', '65a92ed0-eeb1-47fa-89a2-a5f98d2ae5cd', '19f0d298-e683-4cf0-81ce-c3f4dc297898'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:53:50.867356 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:50.926622 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:51.007065 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:53:51.015978 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] Deleted volume successfully. Jan 15 20:53:51.057441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c14ecb21-4e65-447d-9b28-3ebf33efc72f tempest-VolumesAdminNegativeTest-1682858856 None] Lock "b'cinder-2bdef2ab-ec70-41f0-8baa-f2d47689a8ab-delete_volume'" released by "delete_volume" :: held 1.064s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:53:54.412737 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-185f2342-dc06-4dc8-ba91-3f51241775ad tempest-LiveAutoBlockMigrationV225Test-561034217 None] Terminate volume connection completed successfully. Jan 15 20:53:54.413880 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-185f2342-dc06-4dc8-ba91-3f51241775ad tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deleting attachment 4d1a0ffc-d70e-44c7-9347-f232c855cfab. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:53:54.657457 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Lock "b'cinder-de865fb1-204c-482c-a650-62332e1f854e-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:53:54.734748 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:54.855804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:53:54.856190 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] volume has clone snapshot(s) {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1208}} Jan 15 20:53:54.857665 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:53:55.078021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Created reservations ['fe1b63d8-b8c6-4254-8a2a-42e73201ac8a', '646ca31e-70d8-4ab1-8d52-22048c4d222d', '9b7c76d3-6437-400b-b88c-3f01cb8a79b4', '9f4b1a6c-1c02-4faf-9fbc-673a6015dddb'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:53:55.178309 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:55.259244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:55.356589 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:53:55.377358 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deleted volume successfully. Jan 15 20:53:55.430790 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-ddce7330-c765-44f5-a0e3-435ffb58da6f req-f807186e-4d4f-4dd6-9d29-2796134f99f0 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Lock "b'cinder-de865fb1-204c-482c-a650-62332e1f854e-delete_volume'" released by "delete_volume" :: held 0.773s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:53:55.822963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Lock "b'cinder-53534861-c45e-4186-a9c4-9bd3a661cb59-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:53:55.900674 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:56.019416 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:53:56.019767 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Volume volume-53534861-c45e-4186-a9c4-9bd3a661cb59 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:53:56.032211 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] deleting rbd volume volume-53534861-c45e-4186-a9c4-9bd3a661cb59 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:53:56.578788 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Created reservations ['c2249dd8-88e2-4cf5-9134-facbac4d6cff', '45d5da23-bf59-48dc-a71a-53aa8f970981', '59d7dd0a-aee8-468d-b768-81a98bded79d', '58ba6f19-bafe-4e36-b8d8-99306a194e6f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:53:56.675882 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:56.761137 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:53:56.827760 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:53:56.834194 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Deleted volume successfully. Jan 15 20:53:56.863223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a57b512f-156d-474c-96ba-bc398f5ed886 tempest-LiveAutoBlockMigrationV225Test-561034217 None] Lock "b'cinder-53534861-c45e-4186-a9c4-9bd3a661cb59-delete_volume'" released by "delete_volume" :: held 1.040s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:54:32.729228 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:54:32.736730 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:54:32.738504 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:54:32.767756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Flow 'volume_create_manager' (5f1ba937-5469-4ee1-92d8-599b4a11f427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:54:32.777413 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6362588-e8a0-4e4e-9756-69adb2faccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:54:32.785454 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:54:32.802963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6362588-e8a0-4e4e-9756-69adb2faccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1354794175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=684a098f-564a-4f37-94f8-f08328ebc632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7b99384e224302b8ad9303f560cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:54:33Z,use_quota=True,user_id='97b8081a7f0446389dd03a3182585b4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:54:32.809067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06305bd3-f658-4a9f-93fd-50bc7057a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:54:32.814017 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06305bd3-f658-4a9f-93fd-50bc7057a44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:54:32.820874 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c102ec90-cf96-4624-bcbb-49959db623c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:54:32.827768 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c102ec90-cf96-4624-bcbb-49959db623c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684a098f-564a-4f37-94f8-f08328ebc632', 'volume_name': 'volume-684a098f-564a-4f37-94f8-f08328ebc632', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:54:32.833717 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecae16d-377a-45a0-a883-165dd410567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:54:32.838687 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecae16d-377a-45a0-a883-165dd410567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:54:32.844613 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04702fbb-e85c-4e50-9b00-431773588ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:54:32.846083 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Volume 684a098f-564a-4f37-94f8-f08328ebc632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684a098f-564a-4f37-94f8-f08328ebc632', 'volume_size': 1} Jan 15 20:54:32.846724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] creating volume 'volume-684a098f-564a-4f37-94f8-f08328ebc632' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:54:32.848011 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:54:32.959309 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:54:32.959693 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:54:32.965075 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04702fbb-e85c-4e50-9b00-431773588ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684a098f-564a-4f37-94f8-f08328ebc632', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:54:32.974944 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feca048d-4462-4997-9d4b-e7c9b124b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:54:32.999430 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Volume volume-684a098f-564a-4f37-94f8-f08328ebc632 (684a098f-564a-4f37-94f8-f08328ebc632): created successfully Jan 15 20:54:33.003967 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feca048d-4462-4997-9d4b-e7c9b124b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:54:33.019074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Flow 'volume_create_manager' (5f1ba937-5469-4ee1-92d8-599b4a11f427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:54:33.038471 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-022592c3-64d4-40bf-8cdd-3752b8ab7aa7 tempest-AttachSCSIVolumeTestJSON-1803548154 None] Created volume successfully. Jan 15 20:54:34.519184 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-d3c35dca-9912-4d19-9bdd-f98f85b43429 req-e976f7c4-b599-43c9-b9ef-36d981c3924e tempest-AttachSCSIVolumeTestJSON-1803548154 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:54:35.791147 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-d3c35dca-9912-4d19-9bdd-f98f85b43429 req-e976f7c4-b599-43c9-b9ef-36d981c3924e tempest-AttachSCSIVolumeTestJSON-1803548154 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.271s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:54:35.795375 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d3c35dca-9912-4d19-9bdd-f98f85b43429 req-e976f7c4-b599-43c9-b9ef-36d981c3924e tempest-AttachSCSIVolumeTestJSON-1803548154 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-684a098f-564a-4f37-94f8-f08328ebc632', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '684a098f-564a-4f37-94f8-f08328ebc632', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:54:35.851907 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d3c35dca-9912-4d19-9bdd-f98f85b43429 req-e976f7c4-b599-43c9-b9ef-36d981c3924e tempest-AttachSCSIVolumeTestJSON-1803548154 None] Connection info returned from driver {'name': 'volumes/volume-684a098f-564a-4f37-94f8-f08328ebc632', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '684a098f-564a-4f37-94f8-f08328ebc632', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c4f9409c-9061-4608-b390-958acbfb6bbf'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:54:35.948311 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d3c35dca-9912-4d19-9bdd-f98f85b43429 req-e976f7c4-b599-43c9-b9ef-36d981c3924e tempest-AttachSCSIVolumeTestJSON-1803548154 None] attachment_update completed successfully. Jan 15 20:54:39.232481 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 req-39689266-1e2e-44e0-bb4e-c57f081a716e tempest-AttachSCSIVolumeTestJSON-1803548154 None] Terminate volume connection completed successfully. Jan 15 20:54:39.233170 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-2a01fb66-a20c-45b4-a0b3-43a1ca510354 req-39689266-1e2e-44e0-bb4e-c57f081a716e tempest-AttachSCSIVolumeTestJSON-1803548154 None] Deleting attachment c4f9409c-9061-4608-b390-958acbfb6bbf. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:54:40.552806 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:54:40.553612 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:54:40.624714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:54:40.716421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:54:46.704352 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] Lock "b'cinder-684a098f-564a-4f37-94f8-f08328ebc632-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:54:46.837917 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:54:46.947748 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:54:46.949049 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] Volume volume-684a098f-564a-4f37-94f8-f08328ebc632 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:54:46.968023 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] deleting rbd volume volume-684a098f-564a-4f37-94f8-f08328ebc632 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:54:47.494179 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] Created reservations ['93a8d460-e21d-4df4-83db-aa02e1a193bb', 'a866065f-ab35-4d8e-979e-2752e1de11c3', '762e8c09-0d54-42e1-9e2b-1a783f9fb7eb', 'd358b844-6809-4140-be1f-8191ff20e0a4'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:54:47.613317 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:54:47.707827 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:54:47.764724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:54:47.770118 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] Deleted volume successfully. Jan 15 20:54:47.792867 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a3e85d6d-617a-4346-8d43-eaaefe92d52f tempest-AttachSCSIVolumeTestJSON-1803548154 None] Lock "b'cinder-684a098f-564a-4f37-94f8-f08328ebc632-delete_volume'" released by "delete_volume" :: held 1.088s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:55:36.287070 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:55:36.291898 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:55:36.292767 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:55:36.318939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Flow 'volume_create_manager' (120b585c-413f-48f0-959f-2fecd8245951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:55:36.327008 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c145c0a0-c8df-45f3-949f-223c13e895d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:36.350884 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:55:36.377713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c145c0a0-c8df-45f3-949f-223c13e895d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1231493385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f729234b-9e2a-49f0-a5ab-900a73084f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51cad90ef72141c2983640133453f788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:55:36Z,use_quota=True,user_id='765cbcb4d9c8476494f08b123d1db59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:36.388087 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e03ab0e-c3a8-4e1d-a1df-0d683e319c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:36.393721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e03ab0e-c3a8-4e1d-a1df-0d683e319c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:36.400687 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f04a10-ce0a-42ce-8da4-4f11b5e9ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:36.407820 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f04a10-ce0a-42ce-8da4-4f11b5e9ffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f729234b-9e2a-49f0-a5ab-900a73084f63', 'volume_name': 'volume-f729234b-9e2a-49f0-a5ab-900a73084f63', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:36.421405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f552db8c-6a4b-4bb7-ac07-05229bdbbae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:36.426370 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f552db8c-6a4b-4bb7-ac07-05229bdbbae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:36.431921 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43dc608-bb82-41d3-a5e3-fc7a3f1062e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:36.433460 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Volume f729234b-9e2a-49f0-a5ab-900a73084f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f729234b-9e2a-49f0-a5ab-900a73084f63', 'volume_size': 1} Jan 15 20:55:36.434500 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] creating volume 'volume-f729234b-9e2a-49f0-a5ab-900a73084f63' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:55:36.436320 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:55:36.524967 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:55:36.525637 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:55:36.531028 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43dc608-bb82-41d3-a5e3-fc7a3f1062e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f729234b-9e2a-49f0-a5ab-900a73084f63', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:36.551830 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15194d7-72ae-455c-b183-6ca06de4340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:36.578533 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Volume volume-f729234b-9e2a-49f0-a5ab-900a73084f63 (f729234b-9e2a-49f0-a5ab-900a73084f63): created successfully Jan 15 20:55:36.582377 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15194d7-72ae-455c-b183-6ca06de4340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:36.587954 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Flow 'volume_create_manager' (120b585c-413f-48f0-959f-2fecd8245951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:55:36.604196 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e8a0d055-74b6-4db3-a961-1e57f5bb6b7b tempest-DeleteServersTestJSON-2005428209 None] Created volume successfully. Jan 15 20:55:38.970965 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 req-0d8cd3db-a2e4-4c12-bf07-c8bec0f84c9c tempest-DeleteServersTestJSON-2005428209 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:55:39.969122 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 req-0d8cd3db-a2e4-4c12-bf07-c8bec0f84c9c tempest-DeleteServersTestJSON-2005428209 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.998s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:55:39.970376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 req-0d8cd3db-a2e4-4c12-bf07-c8bec0f84c9c tempest-DeleteServersTestJSON-2005428209 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f729234b-9e2a-49f0-a5ab-900a73084f63', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'f729234b-9e2a-49f0-a5ab-900a73084f63', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:55:40.000922 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 req-0d8cd3db-a2e4-4c12-bf07-c8bec0f84c9c tempest-DeleteServersTestJSON-2005428209 None] Connection info returned from driver {'name': 'volumes/volume-f729234b-9e2a-49f0-a5ab-900a73084f63', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f729234b-9e2a-49f0-a5ab-900a73084f63', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fa0bb62d-670e-4c93-98d6-ba54d9ad15d8'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:55:40.089856 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3ea1ffe3-972d-4675-8d70-0eed3d2fed61 req-0d8cd3db-a2e4-4c12-bf07-c8bec0f84c9c tempest-DeleteServersTestJSON-2005428209 None] attachment_update completed successfully. Jan 15 20:55:40.553189 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:55:40.554857 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:55:40.632385 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:55:40.706799 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:55:46.795544 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-94694812-fe12-4933-b42b-f4879df431c9 req-3dcf5bf0-8d44-41ee-815e-53c044d91a78 tempest-DeleteServersTestJSON-2005428209 None] Terminate volume connection completed successfully. Jan 15 20:55:46.796257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-94694812-fe12-4933-b42b-f4879df431c9 req-3dcf5bf0-8d44-41ee-815e-53c044d91a78 tempest-DeleteServersTestJSON-2005428209 None] Deleting attachment fa0bb62d-670e-4c93-98d6-ba54d9ad15d8. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:55:52.251642 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:55:52.256575 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:55:52.257249 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:55:52.277586 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Flow 'volume_create_manager' (d46bee15-d39c-4295-8e27-c1895a369efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:55:52.297421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc56859-ffba-4ff4-9d44-ec9dcffbac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:52.305572 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:55:52.323560 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc56859-ffba-4ff4-9d44-ec9dcffbac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1445450377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=83c3508c-ec47-4aa6-b593-6b635f7ab173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca2cdba56c74d46a478aff355b23447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:55:52Z,use_quota=True,user_id='ca4c2db123e34ed9bdba89f7150ebcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:52.329878 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb4bf67-b869-402d-a5db-d5cc8887c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:52.334610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb4bf67-b869-402d-a5db-d5cc8887c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:52.340781 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1626fa-1487-47aa-84be-00aea838705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:52.457227 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1626fa-1487-47aa-84be-00aea838705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83c3508c-ec47-4aa6-b593-6b635f7ab173', 'volume_name': 'volume-83c3508c-ec47-4aa6-b593-6b635f7ab173', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:52.463068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27f3b6c-e01f-4a3b-b9f4-1890f08c18c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:52.469748 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27f3b6c-e01f-4a3b-b9f4-1890f08c18c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:52.476264 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520184d5-5d13-4b2f-9f04-0b415571d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:52.477982 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Volume 83c3508c-ec47-4aa6-b593-6b635f7ab173: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83c3508c-ec47-4aa6-b593-6b635f7ab173', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 20:55:52.478924 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Cloning 83c3508c-ec47-4aa6-b593-6b635f7ab173 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 20:55:52.494310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:55:52.528600 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 55, 52, 511283)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:55:52.529701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:55:52.530905 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 20:55:52.541152 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:55:52.542153 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 20:55:52.554701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 55, 52, 551394)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:55:52.555555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:55:52.556308 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 20:55:52.570901 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:55:52.667044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] creating snapshot='volume-83c3508c-ec47-4aa6-b593-6b635f7ab173.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 20:55:53.261562 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-83c3508c-ec47-4aa6-b593-6b635f7ab173.clone_snap' to 'volume-83c3508c-ec47-4aa6-b593-6b635f7ab173' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 20:55:53.444624 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:55:53.446315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:55:53.447271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:55:53.478583 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 20:55:53.481167 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Marking volume 83c3508c-ec47-4aa6-b593-6b635f7ab173 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 20:55:53.496271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 83c3508c-ec47-4aa6-b593-6b635f7ab173. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 20:55:53.497879 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Creating volume glance metadata for volume 83c3508c-ec47-4aa6-b593-6b635f7ab173 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 20:55:53.566694 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520184d5-5d13-4b2f-9f04-0b415571d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c3508c-ec47-4aa6-b593-6b635f7ab173', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:53.571788 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f50620b-3221-4eb7-baca-79d68890c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:55:53.581569 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Volume volume-83c3508c-ec47-4aa6-b593-6b635f7ab173 (83c3508c-ec47-4aa6-b593-6b635f7ab173): created successfully Jan 15 20:55:53.585848 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f50620b-3221-4eb7-baca-79d68890c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:55:53.592593 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Flow 'volume_create_manager' (d46bee15-d39c-4295-8e27-c1895a369efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:55:53.602097 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-16e8ad55-91c5-4c6b-9938-326cd794b0ac tempest-ServersTestBootFromVolume-1678952565 None] Created volume successfully. Jan 15 20:55:58.049050 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 req-bd3e4a23-d738-43e4-a8c6-ab08f0695592 tempest-ServersTestBootFromVolume-1678952565 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:55:59.105471 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 req-bd3e4a23-d738-43e4-a8c6-ab08f0695592 tempest-ServersTestBootFromVolume-1678952565 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.056s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:55:59.107707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 req-bd3e4a23-d738-43e4-a8c6-ab08f0695592 tempest-ServersTestBootFromVolume-1678952565 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-83c3508c-ec47-4aa6-b593-6b635f7ab173', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '83c3508c-ec47-4aa6-b593-6b635f7ab173', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:55:59.135179 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 req-bd3e4a23-d738-43e4-a8c6-ab08f0695592 tempest-ServersTestBootFromVolume-1678952565 None] Connection info returned from driver {'name': 'volumes/volume-83c3508c-ec47-4aa6-b593-6b635f7ab173', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '83c3508c-ec47-4aa6-b593-6b635f7ab173', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7d9bc0b5-7e67-4c18-b71a-a509672403ec'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:55:59.198475 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-ee9d2ebd-5d68-4e99-acfa-06b43cb59f25 req-bd3e4a23-d738-43e4-a8c6-ab08f0695592 tempest-ServersTestBootFromVolume-1678952565 None] attachment_update completed successfully. Jan 15 20:56:40.553538 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:56:40.554544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:56:40.621840 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:56:40.663734 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:56:58.517782 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:56:58.527494 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:56:58.528399 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:56:58.569786 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Flow 'volume_create_manager' (ff178dfc-099f-47d1-acd9-22d4540f7819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:56:58.579401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe65fda1-17fe-4ae5-8029-cce537390792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:56:58.589359 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:56:58.609612 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe65fda1-17fe-4ae5-8029-cce537390792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-547097179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=86102022-ce53-4922-9f6d-e99e017681d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a05b1a0a7479db84b762eca23b55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:56:58Z,use_quota=True,user_id='e2ec114f8ece434aa496cd401494e2e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:56:58.615783 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9eaffed-4280-49c9-9be4-816e4dbb6235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:56:58.623941 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9eaffed-4280-49c9-9be4-816e4dbb6235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:56:58.630473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e64970-7eb5-4c41-b35e-65992ae487af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:56:58.635472 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e64970-7eb5-4c41-b35e-65992ae487af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86102022-ce53-4922-9f6d-e99e017681d7', 'volume_name': 'volume-86102022-ce53-4922-9f6d-e99e017681d7', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:56:58.642282 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba32eec-a86a-4653-aacf-e91e1ba65237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:56:58.647340 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba32eec-a86a-4653-aacf-e91e1ba65237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:56:58.655025 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0292433-01a7-4d45-a96c-fff2d506a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:56:58.656934 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Volume 86102022-ce53-4922-9f6d-e99e017681d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86102022-ce53-4922-9f6d-e99e017681d7', 'volume_size': 1} Jan 15 20:56:58.657677 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] creating volume 'volume-86102022-ce53-4922-9f6d-e99e017681d7' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:56:58.659169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:56:58.845150 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:56:58.845553 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:56:58.849992 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0292433-01a7-4d45-a96c-fff2d506a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86102022-ce53-4922-9f6d-e99e017681d7', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:56:58.855658 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9b5037-577a-46ef-bab8-e5f773bd06c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:56:58.888406 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Volume volume-86102022-ce53-4922-9f6d-e99e017681d7 (86102022-ce53-4922-9f6d-e99e017681d7): created successfully Jan 15 20:56:58.894999 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9b5037-577a-46ef-bab8-e5f773bd06c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:56:58.902714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Flow 'volume_create_manager' (ff178dfc-099f-47d1-acd9-22d4540f7819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:56:58.913048 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2ad8a5b4-f5ed-4471-a6b4-34e53cc6145e tempest-LiveMigrationTest-1442391401 None] Created volume successfully. Jan 15 20:57:00.461039 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 req-625af40c-8ad2-4837-80ea-2f2e0532f203 tempest-LiveMigrationTest-1442391401 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:57:01.652663 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 req-625af40c-8ad2-4837-80ea-2f2e0532f203 tempest-LiveMigrationTest-1442391401 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.191s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:57:01.654237 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 req-625af40c-8ad2-4837-80ea-2f2e0532f203 tempest-LiveMigrationTest-1442391401 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86102022-ce53-4922-9f6d-e99e017681d7', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '86102022-ce53-4922-9f6d-e99e017681d7', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:57:01.716668 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 req-625af40c-8ad2-4837-80ea-2f2e0532f203 tempest-LiveMigrationTest-1442391401 None] Connection info returned from driver {'name': 'volumes/volume-86102022-ce53-4922-9f6d-e99e017681d7', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '86102022-ce53-4922-9f6d-e99e017681d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b35d1d3d-443a-4752-a90f-9091d73f239d'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:57:01.859040 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-62ef2268-7cc1-43b5-84ca-32fa9441ae99 req-625af40c-8ad2-4837-80ea-2f2e0532f203 tempest-LiveMigrationTest-1442391401 None] attachment_update completed successfully. Jan 15 20:57:14.391345 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-b03d1b63-cba1-4732-8be8-bf85d5bd44c9 tempest-LiveMigrationTest-46717820 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:57:16.067768 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-b03d1b63-cba1-4732-8be8-bf85d5bd44c9 tempest-LiveMigrationTest-46717820 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.676s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:57:16.068601 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-b03d1b63-cba1-4732-8be8-bf85d5bd44c9 tempest-LiveMigrationTest-46717820 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86102022-ce53-4922-9f6d-e99e017681d7', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '86102022-ce53-4922-9f6d-e99e017681d7', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:57:16.137719 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-b03d1b63-cba1-4732-8be8-bf85d5bd44c9 tempest-LiveMigrationTest-46717820 None] Connection info returned from driver {'name': 'volumes/volume-86102022-ce53-4922-9f6d-e99e017681d7', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '86102022-ce53-4922-9f6d-e99e017681d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9563d2ed-cfb9-4cd3-adfa-17359b4c7a23'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:57:16.245145 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-b03d1b63-cba1-4732-8be8-bf85d5bd44c9 tempest-LiveMigrationTest-46717820 None] attachment_update completed successfully. Jan 15 20:57:31.661878 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-8b3399b9-5c63-4c33-90f1-8ccab7010163 tempest-LiveMigrationTest-46717820 None] Terminate volume connection completed successfully. Jan 15 20:57:31.665314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-37ab256c-5c61-4a04-8bfb-0d7bd17a50b7 req-8b3399b9-5c63-4c33-90f1-8ccab7010163 tempest-LiveMigrationTest-46717820 None] Deleting attachment b35d1d3d-443a-4752-a90f-9091d73f239d. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:57:37.893273 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-0ec7ce4a-681c-4063-9802-077b236f768b req-66057c9a-5e5a-4747-9e49-c62fdb837d8d tempest-LiveMigrationTest-1442391401 None] Terminate volume connection completed successfully. Jan 15 20:57:37.896777 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-0ec7ce4a-681c-4063-9802-077b236f768b req-66057c9a-5e5a-4747-9e49-c62fdb837d8d tempest-LiveMigrationTest-1442391401 None] Deleting attachment 9563d2ed-cfb9-4cd3-adfa-17359b4c7a23. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:57:39.699799 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:57:39.704992 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:57:39.710257 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:57:39.785823 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Flow 'volume_create_manager' (3c0b9ad7-6639-4737-9147-4c8f1bac5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:57:39.795222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2d5e1b-12b2-4222-afb8-64f6600128af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:57:39.811286 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:57:39.854670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2d5e1b-12b2-4222-afb8-64f6600128af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1315818529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f24d67a0-cde3-4074-b10c-8904f7d12e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385a05b1a0a7479db84b762eca23b55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:57:40Z,use_quota=True,user_id='e2ec114f8ece434aa496cd401494e2e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:57:39.863518 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816179cc-0000-4ea6-bc8d-b5f2dae3dea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:57:39.874012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816179cc-0000-4ea6-bc8d-b5f2dae3dea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:57:39.890524 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e50ed4c-06c7-4193-bc2d-5d90b3955c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:57:40.069928 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e50ed4c-06c7-4193-bc2d-5d90b3955c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'volume_name': 'volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:57:40.089765 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac02b5-f55f-4c6e-8fdd-7b2faf029789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:57:40.095773 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac02b5-f55f-4c6e-8fdd-7b2faf029789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:57:40.112829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167997c6-bd0c-4f12-a364-f4b0751eb4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:57:40.127706 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Volume f24d67a0-cde3-4074-b10c-8904f7d12e2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 20:57:40.130812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Cloning f24d67a0-cde3-4074-b10c-8904f7d12e2e from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 20:57:40.145758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:57:40.179887 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 57, 40, 167694)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:57:40.180683 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:57:40.182155 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 20:57:40.188611 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.043s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:57:40.189829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 20:57:40.198015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 57, 40, 194404)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:57:40.198739 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:57:40.199973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 20:57:40.223103 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:57:40.331723 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] creating snapshot='volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 20:57:41.185576 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e.clone_snap' to 'volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 20:57:41.189875 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:57:41.191345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:57:41.314158 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:57:41.387682 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:57:41.447990 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:57:41.449371 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:57:41.449923 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:57:41.485103 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 20:57:41.485779 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Marking volume f24d67a0-cde3-4074-b10c-8904f7d12e2e as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 20:57:41.506002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to f24d67a0-cde3-4074-b10c-8904f7d12e2e. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 20:57:41.506754 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Creating volume glance metadata for volume f24d67a0-cde3-4074-b10c-8904f7d12e2e backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 20:57:41.748439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167997c6-bd0c-4f12-a364-f4b0751eb4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:57:41.765960 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e7af2-0074-4b30-9608-d01464fc3aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:57:41.801679 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Volume volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e (f24d67a0-cde3-4074-b10c-8904f7d12e2e): created successfully Jan 15 20:57:41.813151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e7af2-0074-4b30-9608-d01464fc3aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:57:41.838542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Flow 'volume_create_manager' (3c0b9ad7-6639-4737-9147-4c8f1bac5694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:57:41.865129 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-246195b6-7f16-437a-b4f9-79f8dea3525d tempest-LiveMigrationTest-1442391401 None] Created volume successfully. Jan 15 20:57:46.932216 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-61e33894-37d5-45c7-9578-04b35c51bd35 req-ca30207e-6bd9-4cf6-a7a9-7ded14385dca tempest-LiveMigrationTest-1442391401 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:57:48.218285 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-61e33894-37d5-45c7-9578-04b35c51bd35 req-ca30207e-6bd9-4cf6-a7a9-7ded14385dca tempest-LiveMigrationTest-1442391401 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.287s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:57:48.219984 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-61e33894-37d5-45c7-9578-04b35c51bd35 req-ca30207e-6bd9-4cf6-a7a9-7ded14385dca tempest-LiveMigrationTest-1442391401 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:57:48.268632 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-61e33894-37d5-45c7-9578-04b35c51bd35 req-ca30207e-6bd9-4cf6-a7a9-7ded14385dca tempest-LiveMigrationTest-1442391401 None] Connection info returned from driver {'name': 'volumes/volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '380392b6-458d-4b58-abba-2978bb41421c'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:57:48.380315 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-61e33894-37d5-45c7-9578-04b35c51bd35 req-ca30207e-6bd9-4cf6-a7a9-7ded14385dca tempest-LiveMigrationTest-1442391401 None] attachment_update completed successfully. Jan 15 20:58:02.532746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:58:02.540702 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:58:02.541327 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:58:02.614855 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Flow 'volume_create_manager' (f16bb8c0-118b-4620-b04d-01f81889f892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:02.622344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151a5c63-6eb4-41b0-ab47-f95cbab2ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:02.647914 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:58:02.671412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151a5c63-6eb4-41b0-ab47-f95cbab2ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1888286601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a68031b5-01be-4dd2-bc8c-bd643fdc53d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa080ba5c4e041ae8960caa9e14da5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:58:02Z,use_quota=True,user_id='36d0deec10a44cf7b451501768112c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:02.678440 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7630e6a6-84d6-45f7-977e-c8a3883bb1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:02.684712 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7630e6a6-84d6-45f7-977e-c8a3883bb1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:02.691689 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5755206e-3d3d-46b5-8eef-b44647cb4fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:02.825048 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5755206e-3d3d-46b5-8eef-b44647cb4fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'volume_name': 'volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:02.831556 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb04edd4-b664-4f13-97a3-4f35bc247acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:02.835943 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb04edd4-b664-4f13-97a3-4f35bc247acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:02.841623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02da867f-4805-42b5-97ac-39e20d6d82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:02.843431 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume a68031b5-01be-4dd2-bc8c-bd643fdc53d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 20:58:02.844276 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Cloning a68031b5-01be-4dd2-bc8c-bd643fdc53d4 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 20:58:02.855288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:58:02.870758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 58, 2, 861460)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:58:02.871268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:58:02.871568 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 20:58:02.876029 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:58:02.876988 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 20:58:02.892549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 58, 2, 886843)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:58:02.893010 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:58:02.893424 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 20:58:02.928706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:03.073336 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] creating snapshot='volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 20:58:04.066722 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4.clone_snap' to 'volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 20:58:04.295273 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:58:04.296535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:58:04.297243 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:58:04.339227 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 20:58:04.340095 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Marking volume a68031b5-01be-4dd2-bc8c-bd643fdc53d4 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 20:58:04.352010 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to a68031b5-01be-4dd2-bc8c-bd643fdc53d4. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 20:58:04.352759 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Creating volume glance metadata for volume a68031b5-01be-4dd2-bc8c-bd643fdc53d4 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 20:58:04.458985 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02da867f-4805-42b5-97ac-39e20d6d82fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:04.471625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f71ef7-7526-42f8-9b46-c3d67b57513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:04.490401 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4 (a68031b5-01be-4dd2-bc8c-bd643fdc53d4): created successfully Jan 15 20:58:04.494404 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f71ef7-7526-42f8-9b46-c3d67b57513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:04.516317 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Flow 'volume_create_manager' (f16bb8c0-118b-4620-b04d-01f81889f892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:04.548390 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-db8c651b-b3ef-46d5-b24e-0a35305af4bd tempest-TaggedBootDevicesTest_v242-1223982624 None] Created volume successfully. Jan 15 20:58:05.216975 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:58:05.237613 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:58:05.238078 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:58:05.304465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Flow 'volume_create_manager' (d31fa5ab-057c-434a-8e98-e98526b25602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:05.326730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d811fecd-7a77-4c9c-bd19-48693c1e06af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:05.348702 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:58:05.389996 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d811fecd-7a77-4c9c-bd19-48693c1e06af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-880888300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c24f9c1b-c425-47b2-b6ea-c6857a68ebe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa080ba5c4e041ae8960caa9e14da5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:58:05Z,use_quota=True,user_id='36d0deec10a44cf7b451501768112c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:05.400752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba93e863-0e52-421d-85c8-c23c783d62a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:05.407044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba93e863-0e52-421d-85c8-c23c783d62a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:05.414101 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe62576-e9f7-44a6-9321-1363c5bb9bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:05.421321 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe62576-e9f7-44a6-9321-1363c5bb9bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'volume_name': 'volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:05.427286 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147014a9-5b6d-4032-a851-f60fc0ef7330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:05.434206 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147014a9-5b6d-4032-a851-f60fc0ef7330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:05.440174 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f070b3b1-5b73-4032-81b3-975f8a5232fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:05.441779 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume c24f9c1b-c425-47b2-b6ea-c6857a68ebe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'volume_size': 1} Jan 15 20:58:05.442366 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] creating volume 'volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:58:05.444270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:05.548670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:58:05.549097 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:58:05.553012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f070b3b1-5b73-4032-81b3-975f8a5232fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:05.561183 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74019d62-421b-49cb-8130-145109e3963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:05.582301 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8 (c24f9c1b-c425-47b2-b6ea-c6857a68ebe8): created successfully Jan 15 20:58:05.586635 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74019d62-421b-49cb-8130-145109e3963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:05.596430 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Flow 'volume_create_manager' (d31fa5ab-057c-434a-8e98-e98526b25602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:05.617965 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-72dd1e88-bde3-499f-af07-20745babcbe3 tempest-TaggedBootDevicesTest_v242-1223982624 None] Created volume successfully. Jan 15 20:58:06.864137 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:58:06.871707 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:58:06.872228 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:58:06.936079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Flow 'volume_create_manager' (fe21998c-9e61-4d59-9fe8-f86db2d67bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:06.953016 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3326ee6c-71be-42ca-8b99-4cdb78d84ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:06.969196 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:58:06.989498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3326ee6c-71be-42ca-8b99-4cdb78d84ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-658713959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efb00e0a-c1d0-490c-b037-a9ff38a1ecac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa080ba5c4e041ae8960caa9e14da5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:58:07Z,use_quota=True,user_id='36d0deec10a44cf7b451501768112c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:06.999638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3b7c5f-3533-44a0-88d5-cddf2c828a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:07.011418 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3b7c5f-3533-44a0-88d5-cddf2c828a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:07.017621 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8b6bc8-0b19-4eb0-80b9-659d368571ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:07.022788 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8b6bc8-0b19-4eb0-80b9-659d368571ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'volume_name': 'volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:07.029778 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f0f671-3698-46e7-a261-59b3b7f34e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:07.036011 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f0f671-3698-46e7-a261-59b3b7f34e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:07.043509 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5b4712-b945-4f0c-88a1-39a86c3d60ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:07.045305 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume efb00e0a-c1d0-490c-b037-a9ff38a1ecac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'volume_size': 1} Jan 15 20:58:07.046267 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] creating volume 'volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:58:07.047641 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:07.178147 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:58:07.178970 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:58:07.184129 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5b4712-b945-4f0c-88a1-39a86c3d60ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:07.192407 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06fe6b-891c-4675-9c02-9cdbe93dc5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:07.223348 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac (efb00e0a-c1d0-490c-b037-a9ff38a1ecac): created successfully Jan 15 20:58:07.233751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d06fe6b-891c-4675-9c02-9cdbe93dc5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:07.243628 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Flow 'volume_create_manager' (fe21998c-9e61-4d59-9fe8-f86db2d67bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:07.269605 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ce1eadc9-fda6-4c1e-9493-3882bbf156f2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Created volume successfully. Jan 15 20:58:08.997787 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-dad78f4f-6af1-4f3c-89f9-d2d85c656f0b tempest-LiveMigrationTest-46717820 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:58:10.670049 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-dad78f4f-6af1-4f3c-89f9-d2d85c656f0b tempest-LiveMigrationTest-46717820 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.672s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:58:10.671820 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-dad78f4f-6af1-4f3c-89f9-d2d85c656f0b tempest-LiveMigrationTest-46717820 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:58:10.724052 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-dad78f4f-6af1-4f3c-89f9-d2d85c656f0b tempest-LiveMigrationTest-46717820 None] Connection info returned from driver {'name': 'volumes/volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f24d67a0-cde3-4074-b10c-8904f7d12e2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'eaae1e19-d032-431b-a7e7-e7790ead9ca6'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:58:10.813973 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-dad78f4f-6af1-4f3c-89f9-d2d85c656f0b tempest-LiveMigrationTest-46717820 None] attachment_update completed successfully. Jan 15 20:58:14.252667 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:58:14.262431 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:58:14.266239 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:58:14.409871 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Flow 'volume_create_manager' (95aa7a67-84c9-4ee0-86f6-a97fd00ecb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:14.421731 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7236aa84-a5f2-4953-9322-4a8de76e93cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:14.445043 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:58:14.487903 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7236aa84-a5f2-4953-9322-4a8de76e93cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-162430937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=71f38de6-b902-4c86-aee3-dcc1ab1eaf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a6720be5fb4de7bcd77cc7ef9d8000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:58:14Z,use_quota=True,user_id='05483ff6eec84f78a091b29cfbcf61f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:14.510056 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7bc828-6a37-43e4-b90d-95d280104223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:14.515627 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7bc828-6a37-43e4-b90d-95d280104223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:14.530012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06288e9c-2777-4872-934f-d41ae7825c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:14.540525 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06288e9c-2777-4872-934f-d41ae7825c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f38de6-b902-4c86-aee3-dcc1ab1eaf75', 'volume_name': 'volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:14.554889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b3b4b5-ca16-4fe2-a0d5-f9e397a3921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:14.563448 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b3b4b5-ca16-4fe2-a0d5-f9e397a3921b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:14.577190 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0907f88-5bdf-492b-b5be-f5892575eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:14.578720 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume 71f38de6-b902-4c86-aee3-dcc1ab1eaf75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75', 'volume_size': 1} Jan 15 20:58:14.580084 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] creating volume 'volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:58:14.581473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:14.695202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:58:14.696719 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:58:14.704644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0907f88-5bdf-492b-b5be-f5892575eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:14.711833 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4848b2-998f-4d78-a6b6-ea8ab8e45850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:14.724313 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75 (71f38de6-b902-4c86-aee3-dcc1ab1eaf75): created successfully Jan 15 20:58:14.733812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4848b2-998f-4d78-a6b6-ea8ab8e45850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:14.741592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Flow 'volume_create_manager' (95aa7a67-84c9-4ee0-86f6-a97fd00ecb50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:14.756647 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4a2b75e1-83c7-4fe3-b48a-f3666f8005e6 tempest-ServerRescueNegativeTestJSON-1529536467 None] Created volume successfully. Jan 15 20:58:19.141284 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-58066235-d6dd-4aac-8ede-db5d4391a21c tempest-LiveMigrationTest-46717820 None] Terminate volume connection completed successfully. Jan 15 20:58:19.141853 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3bfb73da-ae5d-48f7-b78c-ac7fdd7b9430 req-58066235-d6dd-4aac-8ede-db5d4391a21c tempest-LiveMigrationTest-46717820 None] Deleting attachment 380392b6-458d-4b58-abba-2978bb41421c. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:58:24.349062 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-f038d444-8862-483c-99d5-b21ea1f4f680 tempest-TaggedBootDevicesTest_v242-1223982624 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:58:25.183161 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-f038d444-8862-483c-99d5-b21ea1f4f680 tempest-TaggedBootDevicesTest_v242-1223982624 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:58:25.183949 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-f038d444-8862-483c-99d5-b21ea1f4f680 tempest-TaggedBootDevicesTest_v242-1223982624 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:58:25.232451 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-f038d444-8862-483c-99d5-b21ea1f4f680 tempest-TaggedBootDevicesTest_v242-1223982624 None] Connection info returned from driver {'name': 'volumes/volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a68031b5-01be-4dd2-bc8c-bd643fdc53d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '97fc20a9-7348-49b0-8692-51b095279aaa'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:58:25.340175 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-f038d444-8862-483c-99d5-b21ea1f4f680 tempest-TaggedBootDevicesTest_v242-1223982624 None] attachment_update completed successfully. Jan 15 20:58:25.810994 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-288a2c7e-56ba-4131-a3f7-6a1a2f26061a tempest-TaggedBootDevicesTest_v242-1223982624 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:58:26.057277 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-390f191a-e87a-4b87-9cd9-b6680eeeccbb tempest-LiveMigrationTest-1442391401 None] Terminate volume connection completed successfully. Jan 15 20:58:26.058467 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-390f191a-e87a-4b87-9cd9-b6680eeeccbb tempest-LiveMigrationTest-1442391401 None] Deleting attachment eaae1e19-d032-431b-a7e7-e7790ead9ca6. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:58:26.303942 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] Lock "b'cinder-f24d67a0-cde3-4074-b10c-8904f7d12e2e-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:58:26.385367 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:26.497566 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:58:26.515650 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] deleting rbd volume volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:58:26.950297 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-288a2c7e-56ba-4131-a3f7-6a1a2f26061a tempest-TaggedBootDevicesTest_v242-1223982624 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.140s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:58:26.951661 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-288a2c7e-56ba-4131-a3f7-6a1a2f26061a tempest-TaggedBootDevicesTest_v242-1223982624 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:58:26.963431 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 20:58:27.041895 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] deleting parent snapshot volume-f24d67a0-cde3-4074-b10c-8904f7d12e2e.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 20:58:27.353458 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-288a2c7e-56ba-4131-a3f7-6a1a2f26061a tempest-TaggedBootDevicesTest_v242-1223982624 None] Connection info returned from driver {'name': 'volumes/volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c24f9c1b-c425-47b2-b6ea-c6857a68ebe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3c18d66a-693f-4618-b369-d0d344b96633'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:58:27.378870 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] Created reservations ['3da3f506-e979-4a8e-9d39-2d2415e06bed', '87075300-2d46-4e48-99c8-2fe55da3224c', '29861993-bad1-4c53-92ad-5b7e2bcac4d4', 'df475574-83cf-4d73-9d1b-0309cc1b95d0'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:58:27.432307 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-288a2c7e-56ba-4131-a3f7-6a1a2f26061a tempest-TaggedBootDevicesTest_v242-1223982624 None] attachment_update completed successfully. Jan 15 20:58:27.474784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:27.554497 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:27.660870 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:58:27.667925 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] Deleted volume successfully. Jan 15 20:58:27.694396 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-e1dfb8f9-b007-4ab0-8018-c5d41ab81026 req-62311892-a31c-4b6e-ba7a-25602fe66fd2 tempest-LiveMigrationTest-1442391401 None] Lock "b'cinder-f24d67a0-cde3-4074-b10c-8904f7d12e2e-delete_volume'" released by "delete_volume" :: held 1.390s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:58:27.903610 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-e1bca05a-ed38-47df-934b-52208c566fb8 tempest-TaggedBootDevicesTest_v242-1223982624 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:58:28.514777 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] Lock "b'cinder-86102022-ce53-4922-9f6d-e99e017681d7-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:58:28.594623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:28.713983 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:58:28.714473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] Volume volume-86102022-ce53-4922-9f6d-e99e017681d7 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:58:28.731044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] deleting rbd volume volume-86102022-ce53-4922-9f6d-e99e017681d7 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:58:29.206358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] Created reservations ['0077b6b4-740c-49a6-bcc1-5dd4ad3c3efa', '3cafd519-be3e-41aa-b52d-89ea0a63637a', '0dd1e4d3-d762-4ed8-b007-7d493e52118d', 'b2774c47-ebb8-45a8-9ebd-284e82738c7e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:58:29.347600 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:29.441079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:29.498345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:58:29.512750 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] Deleted volume successfully. Jan 15 20:58:29.523289 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-e1bca05a-ed38-47df-934b-52208c566fb8 tempest-TaggedBootDevicesTest_v242-1223982624 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.619s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:58:29.525666 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-e1bca05a-ed38-47df-934b-52208c566fb8 tempest-TaggedBootDevicesTest_v242-1223982624 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:58:29.574834 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f3e813ff-360b-4dad-a27f-af3389d0d0ad tempest-LiveMigrationTest-1442391401 None] Lock "b'cinder-86102022-ce53-4922-9f6d-e99e017681d7-delete_volume'" released by "delete_volume" :: held 1.060s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:58:29.579241 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-e1bca05a-ed38-47df-934b-52208c566fb8 tempest-TaggedBootDevicesTest_v242-1223982624 None] Connection info returned from driver {'name': 'volumes/volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'efb00e0a-c1d0-490c-b037-a9ff38a1ecac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '900888f1-2515-41f5-9ae5-3bf7b725321c'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:58:29.694645 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-8e5e2704-fa40-4e20-9c42-f54d20bd5884 req-e1bca05a-ed38-47df-934b-52208c566fb8 tempest-TaggedBootDevicesTest_v242-1223982624 None] attachment_update completed successfully. Jan 15 20:58:38.165876 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:58:38.176947 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:58:38.179069 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:58:38.257517 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Flow 'volume_create_manager' (ce4847d6-c56a-4bb8-9003-068ed0609bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:38.272406 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca651edb-f77f-4000-b4ba-414781a87b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:38.292951 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:58:38.313776 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca651edb-f77f-4000-b4ba-414781a87b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-82090324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba3df6f7-3423-44f7-84bf-6545c2261c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a6720be5fb4de7bcd77cc7ef9d8000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:58:38Z,use_quota=True,user_id='05483ff6eec84f78a091b29cfbcf61f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:38.326681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c0c18e-ae45-4762-8a7c-93ec6a086a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:38.334775 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c0c18e-ae45-4762-8a7c-93ec6a086a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:38.342552 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9f12a5-6c5a-4d66-84de-7530d782e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:38.349021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9f12a5-6c5a-4d66-84de-7530d782e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3df6f7-3423-44f7-84bf-6545c2261c44', 'volume_name': 'volume-ba3df6f7-3423-44f7-84bf-6545c2261c44', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:38.354462 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c1d1cd-69f3-4e5c-8e1d-24b7bce3057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:38.359342 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c1d1cd-69f3-4e5c-8e1d-24b7bce3057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:38.365814 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda16a05-a9c0-428e-80ce-dbe6dba5a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:38.368097 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume ba3df6f7-3423-44f7-84bf-6545c2261c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3df6f7-3423-44f7-84bf-6545c2261c44', 'volume_size': 1} Jan 15 20:58:38.368732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] creating volume 'volume-ba3df6f7-3423-44f7-84bf-6545c2261c44' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:58:38.370638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:38.552043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:58:38.552776 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:58:38.561840 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda16a05-a9c0-428e-80ce-dbe6dba5a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3df6f7-3423-44f7-84bf-6545c2261c44', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:38.570046 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44017ca0-8462-4f6d-8a04-d94a15e80cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:58:38.585598 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume volume-ba3df6f7-3423-44f7-84bf-6545c2261c44 (ba3df6f7-3423-44f7-84bf-6545c2261c44): created successfully Jan 15 20:58:38.591671 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44017ca0-8462-4f6d-8a04-d94a15e80cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:58:38.599343 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Flow 'volume_create_manager' (ce4847d6-c56a-4bb8-9003-068ed0609bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:58:38.615027 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-94962fe0-c2d5-4bb7-af0e-c7db1e836e62 tempest-ServerRescueNegativeTestJSON-1529536467 None] Created volume successfully. Jan 15 20:58:41.197522 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:58:41.199310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:41.263827 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:41.372639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:58:41.575491 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 req-5582bda2-cadc-4a75-a3d5-4463f76b0af9 tempest-ServerRescueNegativeTestJSON-1529536467 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:58:42.430963 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 req-5582bda2-cadc-4a75-a3d5-4463f76b0af9 tempest-ServerRescueNegativeTestJSON-1529536467 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.854s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:58:42.432301 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 req-5582bda2-cadc-4a75-a3d5-4463f76b0af9 tempest-ServerRescueNegativeTestJSON-1529536467 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ba3df6f7-3423-44f7-84bf-6545c2261c44', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'ba3df6f7-3423-44f7-84bf-6545c2261c44', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:58:42.499887 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 req-5582bda2-cadc-4a75-a3d5-4463f76b0af9 tempest-ServerRescueNegativeTestJSON-1529536467 None] Connection info returned from driver {'name': 'volumes/volume-ba3df6f7-3423-44f7-84bf-6545c2261c44', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ba3df6f7-3423-44f7-84bf-6545c2261c44', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1767f0b6-2625-4b9b-918a-d5e863b1970a'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:58:42.595012 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-ba3c901a-8f18-4b3c-a639-fa952d2d7308 req-5582bda2-cadc-4a75-a3d5-4463f76b0af9 tempest-ServerRescueNegativeTestJSON-1529536467 None] attachment_update completed successfully. Jan 15 20:58:51.722681 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-ecf53155-ab43-4584-b62f-fb72803bb3bb tempest-ServersTestBootFromVolume-1678952565 None] Terminate volume connection completed successfully. Jan 15 20:58:51.724222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-ecf53155-ab43-4584-b62f-fb72803bb3bb tempest-ServersTestBootFromVolume-1678952565 None] Deleting attachment 7d9bc0b5-7e67-4c18-b71a-a509672403ec. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:58:51.946657 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] Lock "b'cinder-83c3508c-ec47-4aa6-b593-6b635f7ab173-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:58:52.045190 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:52.174118 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:58:52.188429 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] deleting rbd volume volume-83c3508c-ec47-4aa6-b593-6b635f7ab173 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:58:52.699439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 20:58:52.743645 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] deleting parent snapshot volume-83c3508c-ec47-4aa6-b593-6b635f7ab173.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 20:58:53.279049 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] Created reservations ['73831440-e5c2-4926-8c0f-d0e52ee19e13', 'db7153bf-ef92-404e-aeef-53004a3438da', '68780601-00ba-475f-8181-c4301ea4f49e', '170806c9-befd-401c-ba8d-64d61febb361'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:58:53.395805 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:53.471488 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:58:53.543890 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:58:53.555855 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] Deleted volume successfully. Jan 15 20:58:53.578001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-82cf5f13-ffbe-40e9-9787-c113878b0dcd req-03fab5da-bf18-47d7-a2f1-98a9443dc086 tempest-ServersTestBootFromVolume-1678952565 None] Lock "b'cinder-83c3508c-ec47-4aa6-b593-6b635f7ab173-delete_volume'" released by "delete_volume" :: held 1.631s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:59:10.996931 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] Lock "b'cinder-f729234b-9e2a-49f0-a5ab-900a73084f63-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:59:11.072437 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:11.198006 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:59:11.198487 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] Volume volume-f729234b-9e2a-49f0-a5ab-900a73084f63 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:59:11.206832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] deleting rbd volume volume-f729234b-9e2a-49f0-a5ab-900a73084f63 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:59:11.642876 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] Created reservations ['14e2c7a7-16d9-44d9-b26b-d2ac0e7ab7af', '6efde767-1bff-42f6-866c-ab70b8533c8f', 'c5201511-f973-4ede-b179-1cce5adf43c4', 'b21c4b4e-1d6e-4c4a-8edd-fdc138c12bd1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:59:11.707612 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:11.765468 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:11.837571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:59:11.843095 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] Deleted volume successfully. Jan 15 20:59:11.862341 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-96405f9c-8423-4138-baab-1529d9938c8a tempest-DeleteServersTestJSON-2005428209 None] Lock "b'cinder-f729234b-9e2a-49f0-a5ab-900a73084f63-delete_volume'" released by "delete_volume" :: held 0.865s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:59:19.328693 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 req-fbeb7b9f-aee9-4e6e-8f10-4badc6b42f46 tempest-ServerRescueNegativeTestJSON-1529536467 None] Terminate volume connection completed successfully. Jan 15 20:59:19.328693 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-662d20d5-0990-48d3-8f4c-ed37c5cdcdd3 req-fbeb7b9f-aee9-4e6e-8f10-4badc6b42f46 tempest-ServerRescueNegativeTestJSON-1529536467 None] Deleting attachment 1767f0b6-2625-4b9b-918a-d5e863b1970a. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 20:59:21.166597 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] Lock "b'cinder-ba3df6f7-3423-44f7-84bf-6545c2261c44-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:59:21.250851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:21.350296 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:59:21.351235 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume volume-ba3df6f7-3423-44f7-84bf-6545c2261c44 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:59:21.370167 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] deleting rbd volume volume-ba3df6f7-3423-44f7-84bf-6545c2261c44 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:59:21.856956 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] Created reservations ['be31d79c-87bd-45fb-b419-0ff56c1aec23', '2e0d6056-25a7-476f-9fa5-39ee43b83871', '9c6188e0-910f-4462-8125-0f860dde8644', '0dad43f0-4c09-4f62-acb7-540012ff1337'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:59:21.945702 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:22.015218 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:22.096629 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:59:22.101622 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] Deleted volume successfully. Jan 15 20:59:22.122922 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0877a08e-f40c-4ebf-8dba-51b5bececcee tempest-ServerRescueNegativeTestJSON-1529536467 None] Lock "b'cinder-ba3df6f7-3423-44f7-84bf-6545c2261c44-delete_volume'" released by "delete_volume" :: held 0.965s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:59:22.577925 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] Lock "b'cinder-71f38de6-b902-4c86-aee3-dcc1ab1eaf75-delete_volume'" acquired by "delete_volume" :: waited 0.044s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:59:22.671306 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:22.758533 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 20:59:22.758963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] Volume volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:59:22.767938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] deleting rbd volume volume-71f38de6-b902-4c86-aee3-dcc1ab1eaf75 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 20:59:23.282001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] Created reservations ['00881ef9-5d0e-4615-80f4-163219dfff56', '0638c56e-3114-4c78-a0ba-dbe77c404ed6', '72902bcf-d7e1-417b-9fb7-e9de5ea66830', 'f6b5bb6b-f516-4536-9df1-c26b57c6b654'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 20:59:23.384443 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:23.455444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:23.551409 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:59:23.558661 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] Deleted volume successfully. Jan 15 20:59:23.576930 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-677baaa0-4dd0-4e02-8942-eda7f933e76d tempest-ServerRescueNegativeTestJSON-1529536467 None] Lock "b'cinder-71f38de6-b902-4c86-aee3-dcc1ab1eaf75-delete_volume'" released by "delete_volume" :: held 1.000s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:59:33.795789 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:59:33.810488 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:59:33.810996 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:59:33.889940 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Flow 'volume_create_manager' (10770472-11e0-4467-8691-62a260739621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:59:33.913098 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ab96d4-d9b0-43d4-bab8-8eecafb97938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:33.929603 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:59:33.975603 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ab96d4-d9b0-43d4-bab8-8eecafb97938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-359650486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0914c9c7-c7ec-4509-8149-015f4d73dd20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b36b007e8a9409783a549b87017c8ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:59:34Z,use_quota=True,user_id='f11dc7a8a21449b1b7de146145d51ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:33.989007 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c5d947-9ccd-4a82-b201-2273bc750ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:34.017175 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c5d947-9ccd-4a82-b201-2273bc750ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:34.029814 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534722b6-7568-46ae-ab0c-a8508d26d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:34.174002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534722b6-7568-46ae-ab0c-a8508d26d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0914c9c7-c7ec-4509-8149-015f4d73dd20', 'volume_name': 'volume-0914c9c7-c7ec-4509-8149-015f4d73dd20', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:34.187653 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa65b2-3d02-4b6e-833d-741a8c44546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:34.195631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa65b2-3d02-4b6e-833d-741a8c44546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:34.211656 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0108cd6f-a47c-4d30-9012-232d86db69be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:34.216528 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Volume 0914c9c7-c7ec-4509-8149-015f4d73dd20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0914c9c7-c7ec-4509-8149-015f4d73dd20', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 20:59:34.217566 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Cloning 0914c9c7-c7ec-4509-8149-015f4d73dd20 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 20:59:34.229873 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 20:59:34.249801 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 59, 34, 235258)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:59:34.254514 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:59:34.255812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 20:59:34.266557 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 20:59:34.271444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 20:59:34.288604 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 20, 59, 34, 283157)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 20:59:34.295545 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 20:59:34.296055 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 20:59:34.329989 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:34.487706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] creating snapshot='volume-0914c9c7-c7ec-4509-8149-015f4d73dd20.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 20:59:35.211327 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-0914c9c7-c7ec-4509-8149-015f4d73dd20.clone_snap' to 'volume-0914c9c7-c7ec-4509-8149-015f4d73dd20' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 20:59:35.421361 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 20:59:35.422524 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:59:35.426061 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:59:35.454813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 20:59:35.455487 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Marking volume 0914c9c7-c7ec-4509-8149-015f4d73dd20 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 20:59:35.465925 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 0914c9c7-c7ec-4509-8149-015f4d73dd20. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 20:59:35.466388 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Creating volume glance metadata for volume 0914c9c7-c7ec-4509-8149-015f4d73dd20 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 20:59:35.562634 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0108cd6f-a47c-4d30-9012-232d86db69be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0914c9c7-c7ec-4509-8149-015f4d73dd20', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:35.576292 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2356ad13-8b7e-4c22-b3e0-b7253bc4c287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:35.589148 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Volume volume-0914c9c7-c7ec-4509-8149-015f4d73dd20 (0914c9c7-c7ec-4509-8149-015f4d73dd20): created successfully Jan 15 20:59:35.593156 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2356ad13-8b7e-4c22-b3e0-b7253bc4c287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:35.598999 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Flow 'volume_create_manager' (10770472-11e0-4467-8691-62a260739621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:59:35.621352 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0f6325f1-4578-4f6b-9a42-f228470e10e4 tempest-TaggedBootDevicesTest-1219595898 None] Created volume successfully. Jan 15 20:59:36.361399 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:59:36.382119 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:59:36.382588 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:59:36.420790 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Flow 'volume_create_manager' (3fdd5e28-25c6-439c-8cc8-db9683c2c6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:59:36.439182 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9ad890-1bb9-4604-bafc-00ec2ffd2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:36.447766 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:59:36.463398 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9ad890-1bb9-4604-bafc-00ec2ffd2711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1213317842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa8e576c-d6ef-43bc-bde0-1914820f85a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b36b007e8a9409783a549b87017c8ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:59:36Z,use_quota=True,user_id='f11dc7a8a21449b1b7de146145d51ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:36.469721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bb6b09-34e4-47b9-85cc-199f5c318fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:36.474203 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3bb6b09-34e4-47b9-85cc-199f5c318fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:36.480202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519f152c-f7b4-407e-8c4f-43a2dbc3f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:36.484918 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519f152c-f7b4-407e-8c4f-43a2dbc3f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'volume_name': 'volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:36.490229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23970d8f-752a-44f5-8b35-db4990bf52b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:36.494713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23970d8f-752a-44f5-8b35-db4990bf52b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:36.499891 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4881d7-f36f-4d20-92bf-d0800a9f32c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:36.501334 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Volume aa8e576c-d6ef-43bc-bde0-1914820f85a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'volume_size': 1} Jan 15 20:59:36.501993 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] creating volume 'volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:59:36.503217 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:36.600494 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:59:36.601000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:59:36.605127 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4881d7-f36f-4d20-92bf-d0800a9f32c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:36.610558 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee17f62-c3f1-4d49-bc59-5e54c105f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:36.629983 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Volume volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1 (aa8e576c-d6ef-43bc-bde0-1914820f85a1): created successfully Jan 15 20:59:36.642789 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee17f62-c3f1-4d49-bc59-5e54c105f97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:36.655454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Flow 'volume_create_manager' (3fdd5e28-25c6-439c-8cc8-db9683c2c6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:59:36.677277 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-767abf57-37fe-4235-8baf-025f60bbc042 tempest-TaggedBootDevicesTest-1219595898 None] Created volume successfully. Jan 15 20:59:37.751842 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 20:59:37.757838 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 20:59:37.759685 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 20:59:37.797327 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Flow 'volume_create_manager' (4709e8bf-9015-4826-944b-14241ef8dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:59:37.804996 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786f886b-0312-470c-9202-b283e99de971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:37.812023 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 20:59:37.837464 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786f886b-0312-470c-9202-b283e99de971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T20:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-940691543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9df52e98-8cdf-4ad5-b0c1-c486b68fb042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b36b007e8a9409783a549b87017c8ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T20:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T20:59:38Z,use_quota=True,user_id='f11dc7a8a21449b1b7de146145d51ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:37.843595 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052154dd-a1d3-4a45-a707-96d319faf829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:37.853546 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052154dd-a1d3-4a45-a707-96d319faf829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:37.859754 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3035597-2a50-4c35-b19c-389dc7d00f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:37.870094 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3035597-2a50-4c35-b19c-389dc7d00f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'volume_name': 'volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:37.876640 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e01a3b-74e9-4ae7-a400-bcb14d6852f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:37.881451 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e01a3b-74e9-4ae7-a400-bcb14d6852f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:37.888338 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edec6bde-eafd-441f-9ea2-c703fb28945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:37.890022 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Volume 9df52e98-8cdf-4ad5-b0c1-c486b68fb042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'volume_size': 1} Jan 15 20:59:37.890471 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] creating volume 'volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 20:59:37.891478 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:37.991408 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 20:59:37.992159 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 20:59:37.998597 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edec6bde-eafd-441f-9ea2-c703fb28945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:38.006458 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f65a9f-dd1b-4d28-a29b-d230d6c9443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 20:59:38.020463 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Volume volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042 (9df52e98-8cdf-4ad5-b0c1-c486b68fb042): created successfully Jan 15 20:59:38.026371 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f65a9f-dd1b-4d28-a29b-d230d6c9443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 20:59:38.033460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Flow 'volume_create_manager' (4709e8bf-9015-4826-944b-14241ef8dc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 20:59:38.053890 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ddad2aaf-8622-4466-84e0-39fc2595f0a5 tempest-TaggedBootDevicesTest-1219595898 None] Created volume successfully. Jan 15 20:59:41.200804 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 20:59:41.202326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:41.256579 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 20:59:41.315358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 20:59:57.645234 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-e9e7a0e3-80dd-488d-a2d8-85b28a54b2f1 tempest-TaggedBootDevicesTest-1219595898 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 20:59:58.497944 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-e9e7a0e3-80dd-488d-a2d8-85b28a54b2f1 tempest-TaggedBootDevicesTest-1219595898 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.852s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 20:59:58.498790 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-e9e7a0e3-80dd-488d-a2d8-85b28a54b2f1 tempest-TaggedBootDevicesTest-1219595898 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0914c9c7-c7ec-4509-8149-015f4d73dd20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '0914c9c7-c7ec-4509-8149-015f4d73dd20', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 20:59:58.537340 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-e9e7a0e3-80dd-488d-a2d8-85b28a54b2f1 tempest-TaggedBootDevicesTest-1219595898 None] Connection info returned from driver {'name': 'volumes/volume-0914c9c7-c7ec-4509-8149-015f4d73dd20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0914c9c7-c7ec-4509-8149-015f4d73dd20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'efca1b69-5f66-490c-87a5-f6b2238dc71d'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 20:59:58.642686 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-e9e7a0e3-80dd-488d-a2d8-85b28a54b2f1 tempest-TaggedBootDevicesTest-1219595898 None] attachment_update completed successfully. Jan 15 20:59:59.150691 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-d9e0f208-d7f9-4a00-ad00-6437c0a7b817 tempest-TaggedBootDevicesTest-1219595898 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:00:00.401663 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-d9e0f208-d7f9-4a00-ad00-6437c0a7b817 tempest-TaggedBootDevicesTest-1219595898 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.251s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:00:00.403397 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-d9e0f208-d7f9-4a00-ad00-6437c0a7b817 tempest-TaggedBootDevicesTest-1219595898 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:00:00.450429 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-d9e0f208-d7f9-4a00-ad00-6437c0a7b817 tempest-TaggedBootDevicesTest-1219595898 None] Connection info returned from driver {'name': 'volumes/volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa8e576c-d6ef-43bc-bde0-1914820f85a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b5a088a9-1ead-4a61-ade1-4eae1622e8d8'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:00:00.517338 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-d9e0f208-d7f9-4a00-ad00-6437c0a7b817 tempest-TaggedBootDevicesTest-1219595898 None] attachment_update completed successfully. Jan 15 21:00:01.238222 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-93232f79-518a-4efc-8301-fa9a1a3d130e tempest-TaggedBootDevicesTest-1219595898 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:00:02.742508 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-93232f79-518a-4efc-8301-fa9a1a3d130e tempest-TaggedBootDevicesTest-1219595898 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.504s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:00:02.743465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-93232f79-518a-4efc-8301-fa9a1a3d130e tempest-TaggedBootDevicesTest-1219595898 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:00:02.786176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-93232f79-518a-4efc-8301-fa9a1a3d130e tempest-TaggedBootDevicesTest-1219595898 None] Connection info returned from driver {'name': 'volumes/volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9df52e98-8cdf-4ad5-b0c1-c486b68fb042', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dc405875-4cf5-4127-aa8f-5b64ba076213'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:00:02.882379 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-5c2af6da-8197-4146-bbe4-f104c1162da7 req-93232f79-518a-4efc-8301-fa9a1a3d130e tempest-TaggedBootDevicesTest-1219595898 None] attachment_update completed successfully. Jan 15 21:00:41.200830 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:00:41.202333 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:00:41.250900 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:00:41.307118 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:27.468460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:01:27.473682 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:01:27.474333 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:01:27.497029 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Flow 'volume_create_manager' (f9890a4b-8260-40a5-873f-349fb0c992f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:27.504373 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cd7a48-705b-419c-8c02-4792ca2836c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:27.512005 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:01:27.526681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cd7a48-705b-419c-8c02-4792ca2836c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1902801600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=428ecd34-edb8-4c5b-a0ef-792f33a44f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93361c6f99a64eb5bd8345638936d1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:01:27Z,use_quota=True,user_id='fe80713ecdf94bc9afa9962ee8a85c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:27.532274 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d378361e-1a74-446b-93da-7fd261754453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:27.537137 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d378361e-1a74-446b-93da-7fd261754453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:27.542839 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb3cd62-62c5-428b-bb34-af7493584366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:27.547772 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb3cd62-62c5-428b-bb34-af7493584366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428ecd34-edb8-4c5b-a0ef-792f33a44f46', 'volume_name': 'volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:27.553532 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f73ab17-082b-47db-8bbb-3fa5b279dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:27.558024 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f73ab17-082b-47db-8bbb-3fa5b279dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:27.563007 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78e8d15-e64b-453e-81b7-b076eb161c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:27.564152 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Volume 428ecd34-edb8-4c5b-a0ef-792f33a44f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46', 'volume_size': 1} Jan 15 21:01:27.564573 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] creating volume 'volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:01:27.565702 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:27.764091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:01:27.764482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:01:27.769329 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78e8d15-e64b-453e-81b7-b076eb161c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:27.779078 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4fc177-2ba2-4158-9031-2204a386298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:27.806436 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Volume volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46 (428ecd34-edb8-4c5b-a0ef-792f33a44f46): created successfully Jan 15 21:01:27.811229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4fc177-2ba2-4158-9031-2204a386298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:27.820391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Flow 'volume_create_manager' (f9890a4b-8260-40a5-873f-349fb0c992f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:27.840874 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-dcf66e63-0e6f-4d3b-945e-4437ba8a6b79 req-3a99540d-6f63-453c-bea3-ab59ff31bd8a tempest-VolumesSnapshotsTestJSON-502917034 None] Created volume successfully. Jan 15 21:01:29.002074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-74021b4b-3bb3-4a02-8165-7262c10f0733 req-066270d2-1e95-4fd4-9e8b-26b4710157ae tempest-VolumesSnapshotsTestJSON-502917034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:29.449810 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-74021b4b-3bb3-4a02-8165-7262c10f0733 req-066270d2-1e95-4fd4-9e8b-26b4710157ae tempest-VolumesSnapshotsTestJSON-502917034 None] Create snapshot completed successfully Jan 15 21:01:30.635212 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-2e36b270-1fd0-4302-9e73-e08c6c273fde req-528f469b-a675-4c4e-91f6-d69e7ca924b0 tempest-VolumesSnapshotsTestJSON-502917034 None] Lock "b'cinder-1cda52b6-7abd-4e85-b049-45674f789a78-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:01:30.640752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-2e36b270-1fd0-4302-9e73-e08c6c273fde req-528f469b-a675-4c4e-91f6-d69e7ca924b0 tempest-VolumesSnapshotsTestJSON-502917034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:31.512832 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [req-2e36b270-1fd0-4302-9e73-e08c6c273fde req-528f469b-a675-4c4e-91f6-d69e7ca924b0 tempest-VolumesSnapshotsTestJSON-502917034 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:01:31.551504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-2e36b270-1fd0-4302-9e73-e08c6c273fde req-528f469b-a675-4c4e-91f6-d69e7ca924b0 tempest-VolumesSnapshotsTestJSON-502917034 None] Created reservations ['f3061a7b-a55e-46dd-88bb-a472ca894c32', '4352f46d-f705-4523-ad42-649081b6db71', '1556dd17-ab62-4434-bf66-9d219fa84f99', 'e57ade2c-fa25-4139-abcb-5ccebea44bc5'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:01:31.594870 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-2e36b270-1fd0-4302-9e73-e08c6c273fde req-528f469b-a675-4c4e-91f6-d69e7ca924b0 tempest-VolumesSnapshotsTestJSON-502917034 None] Delete snapshot completed successfully. Jan 15 21:01:31.601024 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-2e36b270-1fd0-4302-9e73-e08c6c273fde req-528f469b-a675-4c4e-91f6-d69e7ca924b0 tempest-VolumesSnapshotsTestJSON-502917034 None] Lock "b'cinder-1cda52b6-7abd-4e85-b049-45674f789a78-delete_snapshot'" released by "delete_snapshot" :: held 0.966s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:01:31.989733 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] Lock "b'cinder-428ecd34-edb8-4c5b-a0ef-792f33a44f46-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:01:32.038577 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:32.118603 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:01:32.119059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] Volume volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:01:32.133376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] deleting rbd volume volume-428ecd34-edb8-4c5b-a0ef-792f33a44f46 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:01:32.580136 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] Created reservations ['875a7a65-301b-457f-a6e5-0527186eea27', '6706cd9b-6ffb-497a-b912-d807166c9e78', '02a0d128-7ec9-461e-9042-4def41edaf4f', 'ccc1bff0-e01b-4a2c-bc8f-d63f2adbfdce'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:01:32.641715 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:32.695749 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:32.766072 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:32.773109 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] Deleted volume successfully. Jan 15 21:01:32.791316 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-e29e5eff-aac7-40f0-8352-329915f68b9f req-44fa105f-07e3-4066-ba54-828030b37420 tempest-VolumesSnapshotsTestJSON-502917034 None] Lock "b'cinder-428ecd34-edb8-4c5b-a0ef-792f33a44f46-delete_volume'" released by "delete_volume" :: held 0.802s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:01:36.113044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:01:36.117032 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:01:36.117491 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:01:36.138043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Flow 'volume_create_manager' (a83f09bb-892a-49fd-b6f4-9cc30dcb5609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:36.144926 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566d8182-6f88-442b-ab91-9b268d055501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:36.151990 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:01:36.168770 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566d8182-6f88-442b-ab91-9b268d055501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-861683177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1d85839d-98dd-473c-bc4b-0dabce6a2d62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f10d236a9434eefab0aa8bc409e68a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:01:36Z,use_quota=True,user_id='1c6e0970d4834fc38db3e8137b869d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:36.178625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89d1962-e098-4fd9-bd5b-4b812c6581cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:36.183695 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89d1962-e098-4fd9-bd5b-4b812c6581cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:36.189741 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c32b21-18ae-46aa-b29b-2fd56dca9006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:36.196697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c32b21-18ae-46aa-b29b-2fd56dca9006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d85839d-98dd-473c-bc4b-0dabce6a2d62', 'volume_name': 'volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:36.202074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd111a-8743-4f64-ad19-ef221ff1b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:36.206858 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd111a-8743-4f64-ad19-ef221ff1b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:36.212712 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a586fc-cfc7-4adc-8dd5-2dde24f05f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:36.213837 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Volume 1d85839d-98dd-473c-bc4b-0dabce6a2d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62', 'volume_size': 1} Jan 15 21:01:36.214226 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] creating volume 'volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:01:36.215200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:36.293550 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:01:36.293959 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:01:36.298278 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a586fc-cfc7-4adc-8dd5-2dde24f05f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:36.303272 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48971678-a0b1-4810-b916-95cf1dafedf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:36.313026 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Volume volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62 (1d85839d-98dd-473c-bc4b-0dabce6a2d62): created successfully Jan 15 21:01:36.317450 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48971678-a0b1-4810-b916-95cf1dafedf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:36.323402 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Flow 'volume_create_manager' (a83f09bb-892a-49fd-b6f4-9cc30dcb5609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:36.334845 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d0e8b573-2466-4254-8e9e-5b47df9a6587 req-470883ee-3eb1-4706-9935-45a15b25cce9 tempest-VolumesGetTestJSON-1089060493 None] Created volume successfully. Jan 15 21:01:37.355401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] Lock "b'cinder-1d85839d-98dd-473c-bc4b-0dabce6a2d62-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:01:37.395238 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:37.443766 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:01:37.444197 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] Volume volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:01:37.451346 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] deleting rbd volume volume-1d85839d-98dd-473c-bc4b-0dabce6a2d62 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:01:37.753178 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] Created reservations ['cc5fb755-c2ba-494d-b6b2-03821a0deabb', '39475b6f-0fdb-4f35-8a35-5275245338ce', '868488c0-e660-4eb5-bef2-4ce83322ad48', 'd1e7138b-7d51-4d18-9f83-1624a0ee4c88'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:01:37.832288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:37.872161 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:37.909616 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:37.914855 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] Deleted volume successfully. Jan 15 21:01:37.927519 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-67f71c4c-cff0-4443-9834-2207ac94dda2 req-8ea9bfa9-9c36-4404-af13-5dcffad88224 tempest-VolumesGetTestJSON-1089060493 None] Lock "b'cinder-1d85839d-98dd-473c-bc4b-0dabce6a2d62-delete_volume'" released by "delete_volume" :: held 0.572s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:01:41.110017 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:01:41.118116 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:01:41.119067 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:01:41.152151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Flow 'volume_create_manager' (7ca5e32b-a1c0-458a-9c4f-82d9948faac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:41.166787 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a943c26-13aa-46d1-b3aa-3cec6d3f0f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:41.176298 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:01:41.192411 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a943c26-13aa-46d1-b3aa-3cec6d3f0f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1727870140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62ee016e4c3a4661aa52fbc3cb29fd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:01:41Z,use_quota=True,user_id='3c787792f0964389b7aafc8dfb363f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:41.199302 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a28e94f-2564-4d08-8cf4-14e359df801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:41.204483 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a28e94f-2564-4d08-8cf4-14e359df801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:41.209890 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ea63e3-98c8-485d-9274-430f2cf97568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:41.214391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ea63e3-98c8-485d-9274-430f2cf97568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae', 'volume_name': 'volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:41.219652 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2023cd-b568-4444-96e8-70cf1fcff576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:41.225138 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2023cd-b568-4444-96e8-70cf1fcff576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:41.230813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35917ccf-d580-4acc-a5ba-a367142b1a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:41.232283 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Volume 96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae', 'volume_size': 1} Jan 15 21:01:41.232969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] creating volume 'volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:01:41.234496 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:41.291208 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:01:41.291964 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:41.365272 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:41.427297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:41.451268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:01:41.452097 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:01:41.478730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35917ccf-d580-4acc-a5ba-a367142b1a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:41.486202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b7cec0-092b-42f6-a6f9-8ced5e5982f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:41.526530 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Volume volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae (96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae): created successfully Jan 15 21:01:41.535967 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b7cec0-092b-42f6-a6f9-8ced5e5982f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:41.551395 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Flow 'volume_create_manager' (7ca5e32b-a1c0-458a-9c4f-82d9948faac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:41.581222 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a99859f9-058a-43b7-a1fb-a7a5afcaaa52 tempest-VolumesTestJSON-1724704593 None] Created volume successfully. Jan 15 21:01:42.609777 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:01:42.618253 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:01:42.619361 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:01:42.642703 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Flow 'volume_create_manager' (ac4fbf0c-b88c-44f1-a50b-5a828442260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:42.649958 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a99d7e5-f81f-4e86-a303-4a40fe0b1623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:42.656316 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:01:42.680691 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a99d7e5-f81f-4e86-a303-4a40fe0b1623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1013229658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=88151be2-e3e8-4786-9c72-cc1bf5f8c7b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62ee016e4c3a4661aa52fbc3cb29fd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:01:43Z,use_quota=True,user_id='3c787792f0964389b7aafc8dfb363f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:42.687828 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4adbf1-0714-43cc-aba5-4b4e1b20667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:42.692899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4adbf1-0714-43cc-aba5-4b4e1b20667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:42.699279 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7519df6d-5e3f-47bb-a534-4db1be8d2cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:42.704799 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7519df6d-5e3f-47bb-a534-4db1be8d2cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88151be2-e3e8-4786-9c72-cc1bf5f8c7b8', 'volume_name': 'volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:42.710462 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86f1b57-c510-49a2-93a9-bd9c167c88c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:42.715046 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86f1b57-c510-49a2-93a9-bd9c167c88c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:42.720262 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d9e1f-e100-4044-9c88-2b5b948de9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:42.722771 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Volume 88151be2-e3e8-4786-9c72-cc1bf5f8c7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8', 'volume_size': 1} Jan 15 21:01:42.723323 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] creating volume 'volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:01:42.724542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:42.827550 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:01:42.828112 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:01:42.833829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d9e1f-e100-4044-9c88-2b5b948de9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:42.843285 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caa75b2-1a56-4193-92da-fad4edb98440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:42.862907 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Volume volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8 (88151be2-e3e8-4786-9c72-cc1bf5f8c7b8): created successfully Jan 15 21:01:42.871061 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caa75b2-1a56-4193-92da-fad4edb98440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:42.878793 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Flow 'volume_create_manager' (ac4fbf0c-b88c-44f1-a50b-5a828442260c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:42.889438 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-95bd184c-c2e1-4fe3-9368-ecc734ef6ac5 tempest-VolumesTestJSON-1724704593 None] Created volume successfully. Jan 15 21:01:44.104953 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:01:44.109217 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:01:44.109730 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:01:44.131388 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Flow 'volume_create_manager' (e45442cb-a98e-492b-9a93-2cb41d52c394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:44.138845 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9886292b-8927-4aeb-b598-a8e5d69e093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:44.147401 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:01:44.163039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9886292b-8927-4aeb-b598-a8e5d69e093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-49002996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3475c51-c24c-4b04-9848-18db8206659f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62ee016e4c3a4661aa52fbc3cb29fd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:01:44Z,use_quota=True,user_id='3c787792f0964389b7aafc8dfb363f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:44.168451 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec7599a-05d8-4bd0-a1f7-af233ab553a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:44.175450 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec7599a-05d8-4bd0-a1f7-af233ab553a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:44.186301 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd23e1e2-3c25-4798-9339-338f02064f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:44.191338 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd23e1e2-3c25-4798-9339-338f02064f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3475c51-c24c-4b04-9848-18db8206659f', 'volume_name': 'volume-b3475c51-c24c-4b04-9848-18db8206659f', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:44.196185 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41a9481-26a0-451a-bfa1-f418b04cde3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:44.200206 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41a9481-26a0-451a-bfa1-f418b04cde3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:44.205124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5deb942-6353-421b-9bef-bdeb55f28b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:44.206287 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Volume b3475c51-c24c-4b04-9848-18db8206659f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3475c51-c24c-4b04-9848-18db8206659f', 'volume_size': 1} Jan 15 21:01:44.206851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] creating volume 'volume-b3475c51-c24c-4b04-9848-18db8206659f' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:01:44.207836 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:44.301654 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:01:44.302541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:01:44.308033 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5deb942-6353-421b-9bef-bdeb55f28b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3475c51-c24c-4b04-9848-18db8206659f', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:44.312466 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42920d96-8667-4d36-b8a5-a515e600d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:01:44.323453 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Volume volume-b3475c51-c24c-4b04-9848-18db8206659f (b3475c51-c24c-4b04-9848-18db8206659f): created successfully Jan 15 21:01:44.332565 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42920d96-8667-4d36-b8a5-a515e600d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:01:44.343285 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Flow 'volume_create_manager' (e45442cb-a98e-492b-9a93-2cb41d52c394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:01:44.364746 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-bbd890b6-1ef0-40c5-aef5-f45be95caa17 tempest-VolumesTestJSON-1724704593 None] Created volume successfully. Jan 15 21:01:46.550948 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] Lock "b'cinder-b3475c51-c24c-4b04-9848-18db8206659f-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:01:46.598907 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:46.690943 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:01:46.691643 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] Volume volume-b3475c51-c24c-4b04-9848-18db8206659f is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:01:46.710110 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] deleting rbd volume volume-b3475c51-c24c-4b04-9848-18db8206659f {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:01:47.157344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] Created reservations ['4499967a-990c-4036-86a6-b265201daf8f', '3afadc4c-345b-43cd-963c-fee5d846afc5', '5224df4a-39a2-4ba0-a884-5c2149654851', '919fd779-ad1c-437d-9bb4-4c2d1a0a0989'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:01:47.253978 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:47.344421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:47.421241 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:47.426431 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] Deleted volume successfully. Jan 15 21:01:47.444398 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3a3d966f-0732-43e1-963b-d5027a2ff6e2 tempest-VolumesTestJSON-1724704593 None] Lock "b'cinder-b3475c51-c24c-4b04-9848-18db8206659f-delete_volume'" released by "delete_volume" :: held 0.893s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:01:47.743655 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] Lock "b'cinder-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:01:47.807485 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:47.889930 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:01:47.891340 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] Volume volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:01:47.909147 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] deleting rbd volume volume-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:01:48.259449 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] Created reservations ['2332d36a-c669-4bde-84cc-12a6fb9875c0', 'f2057ef8-5078-4a58-b2f2-e9b449bb73aa', 'd3fa7ae6-d42b-488a-ae25-2b1361632cf5', 'a7ffd8dd-6b3e-4342-bd02-436e55bd88e7'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:01:48.316294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:48.369473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:48.429991 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:48.434788 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] Deleted volume successfully. Jan 15 21:01:48.451311 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d1b46e1a-ce0a-4bf9-b02b-01c8812fc644 tempest-VolumesTestJSON-1724704593 None] Lock "b'cinder-88151be2-e3e8-4786-9c72-cc1bf5f8c7b8-delete_volume'" released by "delete_volume" :: held 0.708s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:01:48.898728 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] Lock "b'cinder-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:01:48.932705 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:48.990283 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:01:48.991225 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] Volume volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:01:49.002393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] deleting rbd volume volume-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:01:49.379767 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] Created reservations ['4285b54a-5ef9-40bf-925f-84ee0931ff49', '3f37dce8-ca88-4e5d-a2e6-2125efed7915', '4216d12b-c643-4136-8268-a64d33868d6c', '75855186-5c4d-405a-8889-5a054b739c79'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:01:49.429376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:49.485395 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:01:49.563414 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:01:49.570059 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] Deleted volume successfully. Jan 15 21:01:49.587613 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f663b87d-e27e-4f9d-8fa6-4199ac403d7d tempest-VolumesTestJSON-1724704593 None] Lock "b'cinder-96ad96ac-d6ea-4de8-a9b8-65d8d67e8dae-delete_volume'" released by "delete_volume" :: held 0.689s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:02:16.383136 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:02:16.392875 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:02:16.396036 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:02:16.452410 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Flow 'volume_create_manager' (bf71117e-10d7-4761-9a75-24ee67b8446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:02:16.474994 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6bd198-1167-46ad-8476-43f432d28710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:16.489291 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:02:16.517736 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6bd198-1167-46ad-8476-43f432d28710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-786578229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0cd4da7e-0abd-4d64-b27e-2f3b80099824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818a237ecf6b46e389a244c2f33641d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:02:16Z,use_quota=True,user_id='ffbeca0a8c6247bb9cf07d84b7c53a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:16.526798 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fda3601-c2e4-4958-968a-fbc88ad645c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:16.539638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fda3601-c2e4-4958-968a-fbc88ad645c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:16.549188 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ff2990-94fa-40a6-ad12-ff71fca95d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:16.572916 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ff2990-94fa-40a6-ad12-ff71fca95d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'volume_name': 'volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:16.585074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1dc776-ac16-4b6e-8713-30edcaa153cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:16.600833 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1dc776-ac16-4b6e-8713-30edcaa153cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:16.607445 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6def50c6-d76b-4733-b951-d28a786bfdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:16.608875 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Volume 0cd4da7e-0abd-4d64-b27e-2f3b80099824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'volume_size': 1} Jan 15 21:02:16.609698 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] creating volume 'volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:02:16.611762 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:02:16.747704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:02:16.748285 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:02:16.755197 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6def50c6-d76b-4733-b951-d28a786bfdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:16.776621 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb89193-6d65-4d43-b105-2d8fa8155aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:16.796055 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Volume volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824 (0cd4da7e-0abd-4d64-b27e-2f3b80099824): created successfully Jan 15 21:02:16.804257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb89193-6d65-4d43-b105-2d8fa8155aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:16.814434 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Flow 'volume_create_manager' (bf71117e-10d7-4761-9a75-24ee67b8446d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:02:16.838066 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7a2c7baf-ba9f-4627-a4cd-a442896d4d8e tempest-AttachVolumeShelveTestJSON-72753905 None] Created volume successfully. Jan 15 21:02:41.295877 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:02:41.297400 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:02:41.393036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:02:41.460256 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:02:54.819783 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:02:54.823023 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:02:54.823469 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:02:54.844037 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Flow 'volume_create_manager' (7bf740b6-3055-41a4-b0b4-0ab770ec1d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:02:54.854193 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896177cd-2a9f-4b16-8a62-af0065f304c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:54.861626 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:02:54.875918 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896177cd-2a9f-4b16-8a62-af0065f304c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-697359420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca438ded-6045-415d-8f47-bda2befa2363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dad65fccfe481a973f5fcbb9287dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:02:55Z,use_quota=True,user_id='6a6097506a2d4e36818310d9d70bf01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:54.881396 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f074f3ab-a3d8-4997-a296-6ecb37a45905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:54.885933 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f074f3ab-a3d8-4997-a296-6ecb37a45905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:54.891872 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f5568-5119-4478-9ec4-ae99e12ee545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:54.896308 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6f5568-5119-4478-9ec4-ae99e12ee545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca438ded-6045-415d-8f47-bda2befa2363', 'volume_name': 'volume-ca438ded-6045-415d-8f47-bda2befa2363', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:54.901277 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51cbdd3-aeed-43e0-ab1b-45b5dd04cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:54.905282 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51cbdd3-aeed-43e0-ab1b-45b5dd04cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:54.910600 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31887051-7b5c-4b3e-8af1-6769f8f324bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:54.911668 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Volume ca438ded-6045-415d-8f47-bda2befa2363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca438ded-6045-415d-8f47-bda2befa2363', 'volume_size': 1} Jan 15 21:02:54.912055 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] creating volume 'volume-ca438ded-6045-415d-8f47-bda2befa2363' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:02:54.913059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:02:54.976209 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:02:54.976660 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:02:54.985252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31887051-7b5c-4b3e-8af1-6769f8f324bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca438ded-6045-415d-8f47-bda2befa2363', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:54.991151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fd84c7-7bab-404f-bcc4-be8d2467e0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:02:55.003555 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Volume volume-ca438ded-6045-415d-8f47-bda2befa2363 (ca438ded-6045-415d-8f47-bda2befa2363): created successfully Jan 15 21:02:55.012639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fd84c7-7bab-404f-bcc4-be8d2467e0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:02:55.026190 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Flow 'volume_create_manager' (7bf740b6-3055-41a4-b0b4-0ab770ec1d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:02:55.048185 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f0e04065-6ad1-4d5c-bf7c-c7b36d48963b tempest-AttachVolumeTestJSON-1518881454 None] Created volume successfully. Jan 15 21:02:56.598743 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-daecf6ec-adc3-4a33-a231-a49900564a99 req-6d2adcb6-c651-4bae-8ef4-9da766fd8b7f tempest-AttachVolumeTestJSON-1518881454 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:02:57.712128 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-daecf6ec-adc3-4a33-a231-a49900564a99 req-6d2adcb6-c651-4bae-8ef4-9da766fd8b7f tempest-AttachVolumeTestJSON-1518881454 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.114s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:02:57.712963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-daecf6ec-adc3-4a33-a231-a49900564a99 req-6d2adcb6-c651-4bae-8ef4-9da766fd8b7f tempest-AttachVolumeTestJSON-1518881454 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ca438ded-6045-415d-8f47-bda2befa2363', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'ca438ded-6045-415d-8f47-bda2befa2363', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:02:57.805945 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-daecf6ec-adc3-4a33-a231-a49900564a99 req-6d2adcb6-c651-4bae-8ef4-9da766fd8b7f tempest-AttachVolumeTestJSON-1518881454 None] Connection info returned from driver {'name': 'volumes/volume-ca438ded-6045-415d-8f47-bda2befa2363', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ca438ded-6045-415d-8f47-bda2befa2363', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cfa4809e-1145-4c94-adf4-9f7f9231f84e'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:02:57.857940 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-daecf6ec-adc3-4a33-a231-a49900564a99 req-6d2adcb6-c651-4bae-8ef4-9da766fd8b7f tempest-AttachVolumeTestJSON-1518881454 None] attachment_update completed successfully. Jan 15 21:02:58.317079 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-e268a8c5-9968-4305-bdc1-f42408b845cb req-ed39f4c0-0496-48c0-a20b-f1158386b92c tempest-AttachVolumeShelveTestJSON-72753905 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:02:59.138771 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-e268a8c5-9968-4305-bdc1-f42408b845cb req-ed39f4c0-0496-48c0-a20b-f1158386b92c tempest-AttachVolumeShelveTestJSON-72753905 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.821s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:02:59.140326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e268a8c5-9968-4305-bdc1-f42408b845cb req-ed39f4c0-0496-48c0-a20b-f1158386b92c tempest-AttachVolumeShelveTestJSON-72753905 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:02:59.179236 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e268a8c5-9968-4305-bdc1-f42408b845cb req-ed39f4c0-0496-48c0-a20b-f1158386b92c tempest-AttachVolumeShelveTestJSON-72753905 None] Connection info returned from driver {'name': 'volumes/volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0cd4da7e-0abd-4d64-b27e-2f3b80099824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0d34129a-cd6f-4628-88a7-05212d3f9364'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:02:59.288743 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e268a8c5-9968-4305-bdc1-f42408b845cb req-ed39f4c0-0496-48c0-a20b-f1158386b92c tempest-AttachVolumeShelveTestJSON-72753905 None] attachment_update completed successfully. Jan 15 21:03:41.299033 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:03:41.300687 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:03:41.341650 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:03:41.385212 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:03:54.417390 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-fc92592a-c4b7-4036-a947-f10293759f73 req-cecd557b-0b80-41c7-b805-ac34f3635d0b tempest-AttachVolumeTestJSON-1518881454 None] Terminate volume connection completed successfully. Jan 15 21:03:54.418096 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-fc92592a-c4b7-4036-a947-f10293759f73 req-cecd557b-0b80-41c7-b805-ac34f3635d0b tempest-AttachVolumeTestJSON-1518881454 None] Deleting attachment cfa4809e-1145-4c94-adf4-9f7f9231f84e. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:04:02.257598 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-8987df5d-0642-4ecd-87fd-7a790b4d8628 req-d3de990b-a16d-462b-95e2-2f8db5ab5a91 tempest-AttachVolumeShelveTestJSON-72753905 None] Terminate volume connection completed successfully. Jan 15 21:04:02.261878 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-8987df5d-0642-4ecd-87fd-7a790b4d8628 req-d3de990b-a16d-462b-95e2-2f8db5ab5a91 tempest-AttachVolumeShelveTestJSON-72753905 None] Deleting attachment 0d34129a-cd6f-4628-88a7-05212d3f9364. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:04:41.302873 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:04:41.303718 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:41.363948 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:41.413107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:04:43.810875 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:04:43.820471 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:04:43.821301 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:04:43.843780 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Flow 'volume_create_manager' (2a59e093-3e73-4f5c-972d-d76c36f4998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:04:43.851326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9037cf91-7649-4ee2-a977-5de0f53e8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:43.859165 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:04:43.874553 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9037cf91-7649-4ee2-a977-5de0f53e8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2002344926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d7e36b8a-90ed-42f1-8265-a3948446142a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cbf737e9e304c589854184de00a6cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:04:44Z,use_quota=True,user_id='0b2a15fd6d6b4d84828bfdb9fb645db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:43.880509 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f2992e-364f-4d69-9eb5-cd055432ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:43.885353 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f2992e-364f-4d69-9eb5-cd055432ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:43.891433 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76ef47b-3fd6-4fd3-8d04-516325ea1100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:43.896173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76ef47b-3fd6-4fd3-8d04-516325ea1100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e36b8a-90ed-42f1-8265-a3948446142a', 'volume_name': 'volume-d7e36b8a-90ed-42f1-8265-a3948446142a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:43.902664 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc26ea04-7cd9-408a-8fc0-5e2cfd3ad221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:43.907144 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc26ea04-7cd9-408a-8fc0-5e2cfd3ad221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:43.912719 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3259b6-6fb0-48b3-84c4-f6b8171f4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:43.914108 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Volume d7e36b8a-90ed-42f1-8265-a3948446142a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e36b8a-90ed-42f1-8265-a3948446142a', 'volume_size': 1} Jan 15 21:04:43.914719 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] creating volume 'volume-d7e36b8a-90ed-42f1-8265-a3948446142a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:04:43.916069 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:44.007538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:04:44.009037 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:04:44.015631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3259b6-6fb0-48b3-84c4-f6b8171f4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e36b8a-90ed-42f1-8265-a3948446142a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:44.022653 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db82d262-41a0-48a3-9c8a-3da2a2cdf757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:44.035665 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Volume volume-d7e36b8a-90ed-42f1-8265-a3948446142a (d7e36b8a-90ed-42f1-8265-a3948446142a): created successfully Jan 15 21:04:44.041359 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db82d262-41a0-48a3-9c8a-3da2a2cdf757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:44.050472 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Flow 'volume_create_manager' (2a59e093-3e73-4f5c-972d-d76c36f4998a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:04:44.062585 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2a97b020-d567-42be-8d13-bfe079f72c9b tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Created volume successfully. Jan 15 21:04:45.633439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Lock "b'cinder-d7e36b8a-90ed-42f1-8265-a3948446142a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:04:45.670998 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:45.754546 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:04:45.755739 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Volume volume-d7e36b8a-90ed-42f1-8265-a3948446142a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:04:45.765391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] deleting rbd volume volume-d7e36b8a-90ed-42f1-8265-a3948446142a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:04:46.087762 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Created reservations ['30e76780-e3ab-4902-b42f-6b2fa9566b3f', '911d6011-66b1-445b-a076-0c3de9730fd2', '1b3a69bd-c9c5-46f8-b7ee-a937e299898a', 'dd8c9b91-b784-4ec9-9c28-015b6a7de0a5'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:04:46.177173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:46.209044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:46.262793 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:04:46.269340 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Deleted volume successfully. Jan 15 21:04:46.284291 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-068e9bcb-4670-4625-9810-2d7197ce97f6 tempest-VolumeQuotasNegativeTestJSON-1972826818 None] Lock "b'cinder-d7e36b8a-90ed-42f1-8265-a3948446142a-delete_volume'" released by "delete_volume" :: held 0.651s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:04:52.143938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:04:52.147196 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:04:52.147637 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:04:52.167594 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Flow 'volume_create_manager' (119a0d57-0b8f-4b2c-acb6-830516ceb8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:04:52.176799 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb975073-3faf-4b5e-b772-b8caaf3dbbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:52.185972 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:04:52.205109 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb975073-3faf-4b5e-b772-b8caaf3dbbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2027046525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4b525ef-9d59-49d7-832f-311403bb5519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646228c4f0694d04bb4d86082d4a1772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:04:52Z,use_quota=True,user_id='5c9de9071b714ad38fe5026e669478f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:52.212276 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf10c58c-786f-4d4d-aeeb-b6771de742f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:52.218170 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf10c58c-786f-4d4d-aeeb-b6771de742f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:52.223874 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147bb1e5-1aab-45d6-8efb-ade631ecd000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:52.229120 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147bb1e5-1aab-45d6-8efb-ade631ecd000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b525ef-9d59-49d7-832f-311403bb5519', 'volume_name': 'volume-e4b525ef-9d59-49d7-832f-311403bb5519', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:52.237540 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7410febe-fee2-4e67-ba06-30fd8a485f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:52.241944 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7410febe-fee2-4e67-ba06-30fd8a485f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:52.248938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add93bce-ce9f-42d7-8ad7-08fc63339227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:52.250307 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Volume e4b525ef-9d59-49d7-832f-311403bb5519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b525ef-9d59-49d7-832f-311403bb5519', 'volume_size': 1} Jan 15 21:04:52.250703 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] creating volume 'volume-e4b525ef-9d59-49d7-832f-311403bb5519' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:04:52.251722 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:52.341405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:04:52.342551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:04:52.347385 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add93bce-ce9f-42d7-8ad7-08fc63339227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b525ef-9d59-49d7-832f-311403bb5519', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:52.354653 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf1d35b-d3e1-4af8-bacd-f429fd1ed309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:04:52.369543 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Volume volume-e4b525ef-9d59-49d7-832f-311403bb5519 (e4b525ef-9d59-49d7-832f-311403bb5519): created successfully Jan 15 21:04:52.379663 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf1d35b-d3e1-4af8-bacd-f429fd1ed309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:04:52.388624 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Flow 'volume_create_manager' (119a0d57-0b8f-4b2c-acb6-830516ceb8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:04:52.399549 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2c790dfa-459a-4efa-a0ae-a9e114b29d54 tempest-AbsoluteLimitsTests-1631797340 None] Created volume successfully. Jan 15 21:04:53.269439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] Lock "b'cinder-e4b525ef-9d59-49d7-832f-311403bb5519-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:04:53.316692 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:53.385446 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:04:53.386629 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] Volume volume-e4b525ef-9d59-49d7-832f-311403bb5519 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:04:53.394076 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] deleting rbd volume volume-e4b525ef-9d59-49d7-832f-311403bb5519 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:04:53.693298 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] Created reservations ['47edd34e-b008-4504-87b7-f15c77239264', '32233cda-57c9-49e2-a819-c6d02e40074d', 'c3e84b60-27bb-415e-ade6-8bf7d7190e76', 'b1373e54-42f0-4a83-98f8-d15398fe1e75'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:04:53.747213 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:53.780009 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:04:53.811591 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:04:53.816171 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] Deleted volume successfully. Jan 15 21:04:53.829104 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7b6f3504-d590-4f5b-b4ed-23309a7dd6f2 tempest-AbsoluteLimitsTests-1631797340 None] Lock "b'cinder-e4b525ef-9d59-49d7-832f-311403bb5519-delete_volume'" released by "delete_volume" :: held 0.560s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:05:00.127506 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:05:00.131985 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:05:00.132625 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:05:00.154661 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Flow 'volume_create_manager' (defbc483-22e6-41f4-84a4-d13780501862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:05:00.162928 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601ef85c-ac49-4c7c-bc42-d51471017bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:00.170684 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:05:00.187342 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601ef85c-ac49-4c7c-bc42-d51471017bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-868818565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aed8d5d6-bd40-408e-9417-6de1e9baca91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='827745300ee941838a5598e998cf9cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:05:00Z,use_quota=True,user_id='14e5d0b010fc46898ce9bd9b6aff1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:00.194273 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21619d-7e47-484b-9dbb-f449e521a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:00.199499 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21619d-7e47-484b-9dbb-f449e521a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:00.205310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09de4ac3-4458-47ff-b661-231f25d1c8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:00.209909 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09de4ac3-4458-47ff-b661-231f25d1c8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed8d5d6-bd40-408e-9417-6de1e9baca91', 'volume_name': 'volume-aed8d5d6-bd40-408e-9417-6de1e9baca91', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:00.215950 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbab0c5f-a7ef-4e86-99ea-afbe21063b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:00.220249 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbab0c5f-a7ef-4e86-99ea-afbe21063b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:00.225316 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48350529-2bc9-4321-a527-63d135bc8bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:00.226422 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Volume aed8d5d6-bd40-408e-9417-6de1e9baca91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed8d5d6-bd40-408e-9417-6de1e9baca91', 'volume_size': 1} Jan 15 21:05:00.226817 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] creating volume 'volume-aed8d5d6-bd40-408e-9417-6de1e9baca91' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:05:00.227819 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:00.328201 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:05:00.328697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:05:00.332651 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48350529-2bc9-4321-a527-63d135bc8bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed8d5d6-bd40-408e-9417-6de1e9baca91', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:00.338596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cd1284-e200-489c-abcf-b930b4b5d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:00.365982 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Volume volume-aed8d5d6-bd40-408e-9417-6de1e9baca91 (aed8d5d6-bd40-408e-9417-6de1e9baca91): created successfully Jan 15 21:05:00.382295 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cd1284-e200-489c-abcf-b930b4b5d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:00.391649 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Flow 'volume_create_manager' (defbc483-22e6-41f4-84a4-d13780501862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:05:00.403615 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a342417f-fa0a-4641-83f8-e10be9ce4c17 tempest-VolumesListTestJSON-56798510 None] Created volume successfully. Jan 15 21:05:01.531557 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:05:01.534975 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:05:01.535484 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:05:01.555727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Flow 'volume_create_manager' (efc0c669-8ab0-46d4-a06a-b31e67630c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:05:01.562884 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f5f09c-67e0-4a12-a0bd-65420944aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:01.569185 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:05:01.585495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f5f09c-67e0-4a12-a0bd-65420944aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-807906853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=944b56c9-9c7c-4df1-ac84-430a31e71cf3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='827745300ee941838a5598e998cf9cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:05:01Z,use_quota=True,user_id='14e5d0b010fc46898ce9bd9b6aff1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:01.593758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7385e7-9330-43ee-a2b5-81d0b3122fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:01.598325 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7385e7-9330-43ee-a2b5-81d0b3122fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:01.604324 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f669822-02d2-4418-a900-a55a549ed653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:01.609657 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f669822-02d2-4418-a900-a55a549ed653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944b56c9-9c7c-4df1-ac84-430a31e71cf3', 'volume_name': 'volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:01.615017 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd369a8-d0a0-49f7-8be4-201ebe1a75b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:01.619965 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd369a8-d0a0-49f7-8be4-201ebe1a75b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:01.626124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad008fb6-d709-4d8e-957d-9d2e440103b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:01.627413 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Volume 944b56c9-9c7c-4df1-ac84-430a31e71cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3', 'volume_size': 1} Jan 15 21:05:01.627945 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] creating volume 'volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:05:01.629642 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:01.724425 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:05:01.724915 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:05:01.728817 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad008fb6-d709-4d8e-957d-9d2e440103b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:01.734224 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d20443-48ca-4259-b88c-dac464a33c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:01.746099 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Volume volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3 (944b56c9-9c7c-4df1-ac84-430a31e71cf3): created successfully Jan 15 21:05:01.751128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d20443-48ca-4259-b88c-dac464a33c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:01.757119 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Flow 'volume_create_manager' (efc0c669-8ab0-46d4-a06a-b31e67630c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:05:01.766482 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4e93dd07-96f6-4de4-bc56-9ff6abdbd460 tempest-VolumesListTestJSON-56798510 None] Created volume successfully. Jan 15 21:05:02.925220 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:05:02.928526 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:05:02.929035 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:05:02.951605 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Flow 'volume_create_manager' (7a35dc28-86dc-493a-a274-ed9d1f8c1f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:05:02.958673 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6848701b-a145-41fc-aaf4-aafa0e0c8569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:02.966566 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:05:02.983718 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6848701b-a145-41fc-aaf4-aafa0e0c8569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-445179476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef73551b-382e-4622-8476-cf1b807a818b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='827745300ee941838a5598e998cf9cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:05:03Z,use_quota=True,user_id='14e5d0b010fc46898ce9bd9b6aff1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:02.990028 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58299fc1-e4a0-45b9-aa6a-ce7b5937707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:02.994538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58299fc1-e4a0-45b9-aa6a-ce7b5937707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:03.001685 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358048a7-a7a6-411c-97f0-c56fe7f68654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:03.006372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358048a7-a7a6-411c-97f0-c56fe7f68654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef73551b-382e-4622-8476-cf1b807a818b', 'volume_name': 'volume-ef73551b-382e-4622-8476-cf1b807a818b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:03.012444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafeee5e-7811-42c4-b993-b0abdf55b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:03.016901 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafeee5e-7811-42c4-b993-b0abdf55b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:03.022022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab702b8-4993-40bd-a1d8-aa12f2ef25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:03.023079 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Volume ef73551b-382e-4622-8476-cf1b807a818b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef73551b-382e-4622-8476-cf1b807a818b', 'volume_size': 1} Jan 15 21:05:03.023463 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] creating volume 'volume-ef73551b-382e-4622-8476-cf1b807a818b' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:05:03.024486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:03.110916 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:05:03.111294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:05:03.115384 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab702b8-4993-40bd-a1d8-aa12f2ef25d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef73551b-382e-4622-8476-cf1b807a818b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:03.121092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7711ddcc-1db5-4494-b38e-2e0088ac0e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:05:03.130729 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Volume volume-ef73551b-382e-4622-8476-cf1b807a818b (ef73551b-382e-4622-8476-cf1b807a818b): created successfully Jan 15 21:05:03.134655 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7711ddcc-1db5-4494-b38e-2e0088ac0e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:05:03.140714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Flow 'volume_create_manager' (7a35dc28-86dc-493a-a274-ed9d1f8c1f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:05:03.149154 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-06cc98aa-339a-45d9-8d19-6b4ef495640f tempest-VolumesListTestJSON-56798510 None] Created volume successfully. Jan 15 21:05:07.120988 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] Lock "b'cinder-ef73551b-382e-4622-8476-cf1b807a818b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:05:07.232526 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:07.333314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:05:07.334089 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] Volume volume-ef73551b-382e-4622-8476-cf1b807a818b is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:05:07.345863 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] deleting rbd volume volume-ef73551b-382e-4622-8476-cf1b807a818b {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:05:07.803142 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] Created reservations ['f7c58be6-0227-49a7-89f5-acfa89cc6cb6', 'f07fd2ec-b650-42bf-b09b-1208096791bc', '90966721-3cd5-4fdd-b960-a736b2889322', '8bd66bd5-24ba-47bb-b9f5-0fcb1a691f3c'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:05:07.868477 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:07.953639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:08.016652 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:05:08.021659 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] Deleted volume successfully. Jan 15 21:05:08.058721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a88061be-a562-409c-98d1-b12bd8ce8689 tempest-VolumesListTestJSON-56798510 None] Lock "b'cinder-ef73551b-382e-4622-8476-cf1b807a818b-delete_volume'" released by "delete_volume" :: held 0.940s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:05:08.320034 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] Lock "b'cinder-944b56c9-9c7c-4df1-ac84-430a31e71cf3-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:05:08.367551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:08.445336 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:05:08.445753 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] Volume volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:05:08.458971 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] deleting rbd volume volume-944b56c9-9c7c-4df1-ac84-430a31e71cf3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:05:08.919002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] Created reservations ['8c8c3238-0bad-4b57-9d78-66b71fa2c1d3', '43dcba18-2ef9-4525-b549-8bf7c7d32042', '7c39cfe5-6c74-42f7-8e74-370cb6e23f45', 'c7731905-c18d-418f-9a58-88e4f3d299a6'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:05:08.999769 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:09.076719 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:09.139830 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:05:09.155831 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] Deleted volume successfully. Jan 15 21:05:09.183490 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-383d0f6a-f774-445c-8d16-8edc375e9e9a tempest-VolumesListTestJSON-56798510 None] Lock "b'cinder-944b56c9-9c7c-4df1-ac84-430a31e71cf3-delete_volume'" released by "delete_volume" :: held 0.863s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:05:09.523934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] Lock "b'cinder-aed8d5d6-bd40-408e-9417-6de1e9baca91-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:05:09.592113 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:09.677640 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:05:09.678119 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] Volume volume-aed8d5d6-bd40-408e-9417-6de1e9baca91 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:05:09.690620 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] deleting rbd volume volume-aed8d5d6-bd40-408e-9417-6de1e9baca91 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:05:10.168378 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] Created reservations ['75f85450-8e2d-4ba5-8de4-9440519a75ba', 'f1d833ae-9b82-4faf-940e-fdd37fc71ec3', '8df7bbd5-d08d-40aa-8a11-e3e01d7f83fc', '355c5fa3-f332-440b-8ba3-2de91a5ca47a'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:05:10.271027 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:10.342309 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:10.444678 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:05:10.450173 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] Deleted volume successfully. Jan 15 21:05:10.466272 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1350a7b8-cf77-4a0f-b996-79c79af123fd tempest-VolumesListTestJSON-56798510 None] Lock "b'cinder-aed8d5d6-bd40-408e-9417-6de1e9baca91-delete_volume'" released by "delete_volume" :: held 0.942s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:05:41.299071 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:05:41.299784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:41.344652 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:05:41.395959 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:06:11.668404 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:11.671809 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:11.672519 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:11.693785 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Flow 'volume_create_manager' (ac393a62-a8b5-4eac-b168-d118a41212fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:11.702588 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ca57e7-6fee-4109-8ff3-4dfcda4c9aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:11.711547 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:11.725756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ca57e7-6fee-4109-8ff3-4dfcda4c9aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1549173204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e452f945-747c-45ae-b549-0903752da1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818a237ecf6b46e389a244c2f33641d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:12Z,use_quota=True,user_id='ffbeca0a8c6247bb9cf07d84b7c53a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:11.731967 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5743dcd1-60c4-4cfe-b3bc-96196b192013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:11.736755 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5743dcd1-60c4-4cfe-b3bc-96196b192013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:11.743473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cdd8db-9b99-4ec0-a3c4-26a580e37a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:11.748155 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cdd8db-9b99-4ec0-a3c4-26a580e37a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e452f945-747c-45ae-b549-0903752da1dd', 'volume_name': 'volume-e452f945-747c-45ae-b549-0903752da1dd', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:11.754110 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3beb71-bf69-4566-bda2-f8bc99daa99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:11.759256 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3beb71-bf69-4566-bda2-f8bc99daa99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:11.764555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727675a6-8906-4bff-8dd1-48174e0e3a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:11.766005 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Volume e452f945-747c-45ae-b549-0903752da1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e452f945-747c-45ae-b549-0903752da1dd', 'volume_size': 1} Jan 15 21:06:11.766412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] creating volume 'volume-e452f945-747c-45ae-b549-0903752da1dd' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:11.767395 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:11.845238 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:11.846044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:11.851562 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727675a6-8906-4bff-8dd1-48174e0e3a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e452f945-747c-45ae-b549-0903752da1dd', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:11.858966 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeccfc1-4523-409f-a851-a5ce8b5f6b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:11.873131 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Volume volume-e452f945-747c-45ae-b549-0903752da1dd (e452f945-747c-45ae-b549-0903752da1dd): created successfully Jan 15 21:06:11.876795 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeccfc1-4523-409f-a851-a5ce8b5f6b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:11.882389 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Flow 'volume_create_manager' (ac393a62-a8b5-4eac-b168-d118a41212fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:11.891784 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-26456092-acc6-4d5c-b30e-fa8712b6d37c tempest-AttachVolumeShelveTestJSON-72753905 None] Created volume successfully. Jan 15 21:06:17.224288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:17.228278 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:17.228830 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:17.249128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Flow 'volume_create_manager' (34ac4c6d-e6a0-472f-b9ff-97fe61b2f841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:17.255948 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90cf740-585b-4805-8e20-f88d951c138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:17.262721 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:17.276513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90cf740-585b-4805-8e20-f88d951c138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1896737517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e5de2672-7637-4bb0-9bdd-119ea1ef7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111fe1b94a704d8a86f99460865d891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:17Z,use_quota=True,user_id='33402206c63c434b9a6e4affa7db1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:17.281982 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9ca3e2-b248-478e-8d28-5a9592131701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:17.286156 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9ca3e2-b248-478e-8d28-5a9592131701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:17.291992 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed688fd4-c5dc-4dd6-9934-abbca10c5897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:17.296493 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed688fd4-c5dc-4dd6-9934-abbca10c5897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'volume_name': 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:17.301745 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa24db7-027c-4e96-aeb3-d4fc3dd3b466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:17.306691 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa24db7-027c-4e96-aeb3-d4fc3dd3b466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:17.311413 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcda2e9-e000-4ac3-8d0e-b0616f108cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:17.312482 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Volume e5de2672-7637-4bb0-9bdd-119ea1ef7019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'volume_size': 1} Jan 15 21:06:17.312889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] creating volume 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:17.313865 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:17.382812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:17.383261 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:17.387120 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcda2e9-e000-4ac3-8d0e-b0616f108cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:17.391862 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a669730d-e809-42a9-b652-3fb4f00c2f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:17.401495 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Volume volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019 (e5de2672-7637-4bb0-9bdd-119ea1ef7019): created successfully Jan 15 21:06:17.405180 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a669730d-e809-42a9-b652-3fb4f00c2f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:17.413697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Flow 'volume_create_manager' (34ac4c6d-e6a0-472f-b9ff-97fe61b2f841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:17.421399 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-52c631bc-ec68-44cf-baf2-d807361dfc9e tempest-VolumesBackupsAdminTest-678024116 None] Created volume successfully. Jan 15 21:06:23.952928 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:06:24.630610 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.677s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:06:24.631415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'e5de2672-7637-4bb0-9bdd-119ea1ef7019', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:06:24.650007 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Initialize volume connection completed successfully. Jan 15 21:06:28.513983 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Terminate volume connection completed successfully. Jan 15 21:06:28.535566 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-23a160c1-b802-47bd-91b9-ed7b599a9976 tempest-VolumesBackupsAdminTest-678024116 None] Remove volume export completed successfully. Jan 15 21:06:31.091623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:31.106932 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:31.108696 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:31.145369 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Flow 'volume_create_manager' (8b15ba4f-a500-4b5a-8e23-054388ea1d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:31.155436 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee06af9-b9b6-4ca6-8b21-8dbd70c6327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:31.164078 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:31.186304 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee06af9-b9b6-4ca6-8b21-8dbd70c6327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:31Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_98d8d09d-e78c-4488-9025-62f226b85792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=abd3a57e-51e6-4369-840b-787555ee0c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111fe1b94a704d8a86f99460865d891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:31Z,use_quota=True,user_id='33402206c63c434b9a6e4affa7db1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:31.194219 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fe571d-f27b-44ee-b82c-04990d362294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:31.200302 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fe571d-f27b-44ee-b82c-04990d362294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:31.206656 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0903fd19-0cc3-44d7-9947-872132af04ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:31.211837 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0903fd19-0cc3-44d7-9947-872132af04ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd3a57e-51e6-4369-840b-787555ee0c83', 'volume_name': 'volume-abd3a57e-51e6-4369-840b-787555ee0c83', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:31.218330 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8d3196-854a-445c-8e7f-2cc9adc334da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:31.224181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8d3196-854a-445c-8e7f-2cc9adc334da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:31.232422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83a2b84-d940-4997-8f82-682d40340f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:31.234280 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Volume abd3a57e-51e6-4369-840b-787555ee0c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd3a57e-51e6-4369-840b-787555ee0c83', 'volume_size': 1} Jan 15 21:06:31.234927 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] creating volume 'volume-abd3a57e-51e6-4369-840b-787555ee0c83' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:31.236300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:31.387471 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:31.387921 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:31.392987 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83a2b84-d940-4997-8f82-682d40340f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd3a57e-51e6-4369-840b-787555ee0c83', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:31.397495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff88e40f-19e1-49f4-9033-9013f2e13887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:31.411387 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Volume volume-abd3a57e-51e6-4369-840b-787555ee0c83 (abd3a57e-51e6-4369-840b-787555ee0c83): created successfully Jan 15 21:06:31.418225 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff88e40f-19e1-49f4-9033-9013f2e13887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:31.428422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Flow 'volume_create_manager' (8b15ba4f-a500-4b5a-8e23-054388ea1d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:31.444439 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Created volume successfully. Jan 15 21:06:32.219932 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:06:33.121305 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.901s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:06:33.122509 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-abd3a57e-51e6-4369-840b-787555ee0c83', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'abd3a57e-51e6-4369-840b-787555ee0c83', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:06:33.142715 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Initialize volume connection completed successfully. Jan 15 21:06:35.155186 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Terminate volume connection completed successfully. Jan 15 21:06:35.184752 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-428e14d4-145f-41a7-9911-9a1e71650bf9 tempest-VolumesBackupsAdminTest-678024116 None] Remove volume export completed successfully. Jan 15 21:06:36.497498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] Lock "b'cinder-abd3a57e-51e6-4369-840b-787555ee0c83-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:06:36.542035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:36.841390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] Volume volume-abd3a57e-51e6-4369-840b-787555ee0c83 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:06:36.875856 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] deleting rbd volume volume-abd3a57e-51e6-4369-840b-787555ee0c83 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:06:37.263298 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] Created reservations ['0acda6cb-214d-4f1f-83a6-c7f6735f79b0', '9a221028-c9a5-44f5-9bfb-22b901ae1bf3', '3cbc737e-5c89-4643-aa22-5a61f4853647', 'e97a35b8-1021-4436-9417-fe5a06205bfd'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:06:37.329660 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:37.404336 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:37.461855 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:06:37.470491 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] Deleted volume successfully. Jan 15 21:06:37.488752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-77c1c423-65ec-4710-b234-3a35b62e92e3 tempest-VolumesBackupsAdminTest-678024116 None] Lock "b'cinder-abd3a57e-51e6-4369-840b-787555ee0c83-delete_volume'" released by "delete_volume" :: held 0.992s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:06:40.498680 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:40.502340 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:40.502907 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:40.524573 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Flow 'volume_create_manager' (50f16f9b-58d5-4e62-8ed3-23074339f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:40.531863 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9bf84d-86d6-4883-ad78-83ba2f2ccb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:40.539018 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:40.555015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9bf84d-86d6-4883-ad78-83ba2f2ccb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1416720262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c44cffd2-194b-406a-bbec-b2a2b48d795b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111fe1b94a704d8a86f99460865d891a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:40Z,use_quota=True,user_id='33402206c63c434b9a6e4affa7db1ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:40.560972 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b421c1c-9c46-42c4-b0b2-0fabdb9c8ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:40.565444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b421c1c-9c46-42c4-b0b2-0fabdb9c8ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:40.570812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d27b9d3-1a47-412a-b90d-2b9c9644a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:40.575384 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d27b9d3-1a47-412a-b90d-2b9c9644a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44cffd2-194b-406a-bbec-b2a2b48d795b', 'volume_name': 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:40.580787 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bfaed-14f7-4ee0-8c5d-35e2735a36f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:40.585275 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bfaed-14f7-4ee0-8c5d-35e2735a36f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:40.590067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62976103-c552-4e5e-bf0b-4e9ef341c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:40.591367 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Volume c44cffd2-194b-406a-bbec-b2a2b48d795b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b', 'volume_size': 1} Jan 15 21:06:40.591936 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] creating volume 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:40.593167 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:40.673651 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:40.674435 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:40.678893 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62976103-c552-4e5e-bf0b-4e9ef341c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44cffd2-194b-406a-bbec-b2a2b48d795b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:40.685005 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c29dc5-e37c-4217-9585-21a152717812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:40.696386 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Volume volume-c44cffd2-194b-406a-bbec-b2a2b48d795b (c44cffd2-194b-406a-bbec-b2a2b48d795b): created successfully Jan 15 21:06:40.700489 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c29dc5-e37c-4217-9585-21a152717812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:40.707213 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Flow 'volume_create_manager' (50f16f9b-58d5-4e62-8ed3-23074339f638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:40.719889 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-21de8828-9215-4282-a114-d1d8b263ae00 tempest-VolumesBackupsAdminTest-678024116 None] Created volume successfully. Jan 15 21:06:41.304382 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:06:41.305236 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:41.400428 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:41.462884 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:06:41.925117 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:06:42.849065 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.923s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:06:42.849919 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c44cffd2-194b-406a-bbec-b2a2b48d795b', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'c44cffd2-194b-406a-bbec-b2a2b48d795b', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:06:42.905201 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Initialize volume connection completed successfully. Jan 15 21:06:43.973080 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Terminate volume connection completed successfully. Jan 15 21:06:44.006476 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-106464ea-f064-4dc9-af22-84e04390a98b tempest-VolumesBackupsAdminTest-678024116 None] Remove volume export completed successfully. Jan 15 21:06:45.895339 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 req-f9f7ca05-e698-4ac5-b4a5-9b90d4a40986 tempest-AttachVolumeShelveTestJSON-72753905 None] No connector for attachment 97c9c981-9b59-4622-b745-906774d423a8; skipping storage backend terminate_connection call. {{(pid=122725) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4903}} Jan 15 21:06:45.896904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-473cf5dc-ecb9-4a07-92c8-bf2f1f25dcd2 req-f9f7ca05-e698-4ac5-b4a5-9b90d4a40986 tempest-AttachVolumeShelveTestJSON-72753905 None] Deleting attachment 97c9c981-9b59-4622-b745-906774d423a8. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:06:47.200648 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] Lock "b'cinder-c44cffd2-194b-406a-bbec-b2a2b48d795b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:06:47.251608 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:48.298547 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] Volume volume-c44cffd2-194b-406a-bbec-b2a2b48d795b is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:06:48.325225 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] deleting rbd volume volume-c44cffd2-194b-406a-bbec-b2a2b48d795b {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:06:48.704704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] Created reservations ['25978701-8244-42e9-ae24-d2c6a75ae8d6', 'c8477d0e-76a6-400f-b295-95c27e3110ee', 'dbf1c825-7134-40e3-a80f-0ba3f9046695', '9c5e760d-78b7-42c4-816c-451e749ec577'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:06:48.761827 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:48.834513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:48.910460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:06:48.922306 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] Deleted volume successfully. Jan 15 21:06:48.947210 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2868b942-9d53-4baa-96e9-d81a06ef36e3 tempest-VolumesBackupsAdminTest-678024116 None] Lock "b'cinder-c44cffd2-194b-406a-bbec-b2a2b48d795b-delete_volume'" released by "delete_volume" :: held 1.747s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:06:49.567258 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] Lock "b'cinder-e5de2672-7637-4bb0-9bdd-119ea1ef7019-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:06:49.653459 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:50.808218 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] Volume volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:06:50.839018 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] deleting rbd volume volume-e5de2672-7637-4bb0-9bdd-119ea1ef7019 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:06:50.915268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:50.951360 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:50.953661 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:51.074020 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Flow 'volume_create_manager' (1e97089c-97c2-433a-b76c-d9674607e402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:51.115656 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8db622-73b5-48c7-b8db-4af140692f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:51.137937 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:51.174141 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8db622-73b5-48c7-b8db-4af140692f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-237921578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39a9f446-bda4-412e-b835-f0b04d414fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dad65fccfe481a973f5fcbb9287dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:50Z,use_quota=True,user_id='6a6097506a2d4e36818310d9d70bf01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:51.203073 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99572f9-2106-4c8f-9718-841ef58ff76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:51.208993 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99572f9-2106-4c8f-9718-841ef58ff76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:51.223489 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92e1677-e0c4-408e-a8f4-8a92e0b5c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:51.239681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92e1677-e0c4-408e-a8f4-8a92e0b5c696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a9f446-bda4-412e-b835-f0b04d414fed', 'volume_name': 'volume-39a9f446-bda4-412e-b835-f0b04d414fed', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:51.255338 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4961023f-e5da-4aff-9939-09e5830a9ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:51.266786 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4961023f-e5da-4aff-9939-09e5830a9ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:51.301547 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b1e7b3-4736-4896-aad1-acc06609a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:51.303006 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Volume 39a9f446-bda4-412e-b835-f0b04d414fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a9f446-bda4-412e-b835-f0b04d414fed', 'volume_size': 1} Jan 15 21:06:51.306681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] creating volume 'volume-39a9f446-bda4-412e-b835-f0b04d414fed' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:51.308708 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:51.439411 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:51.439968 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:51.444946 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b1e7b3-4736-4896-aad1-acc06609a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a9f446-bda4-412e-b835-f0b04d414fed', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:51.453156 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8805be0b-4067-4850-a172-35cc77cffda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:51.480781 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Volume volume-39a9f446-bda4-412e-b835-f0b04d414fed (39a9f446-bda4-412e-b835-f0b04d414fed): created successfully Jan 15 21:06:51.488220 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8805be0b-4067-4850-a172-35cc77cffda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:51.499112 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Flow 'volume_create_manager' (1e97089c-97c2-433a-b76c-d9674607e402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:51.534065 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-040ccbd5-a55d-4ee8-ad97-3602a5528d04 tempest-AttachVolumeTestJSON-1518881454 None] Created volume successfully. Jan 15 21:06:51.544403 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] Created reservations ['5c999d55-2200-4134-9ca6-e1f0757c74c5', '98048b50-91c1-43cc-ba4e-3ed9d82abc79', '6a96fd74-ddf5-48cd-89fe-16581ec4d849', 'e91deb10-fe1f-4b1d-953c-618bf1502ce7'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:06:51.622500 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:51.711769 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:51.804333 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:06:51.809329 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] Deleted volume successfully. Jan 15 21:06:51.842066 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3a323fcd-ad22-42ae-b84e-31c3c8120e8e tempest-VolumesBackupsAdminTest-678024116 None] Lock "b'cinder-e5de2672-7637-4bb0-9bdd-119ea1ef7019-delete_volume'" released by "delete_volume" :: held 2.274s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:06:52.732911 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 req-4023e5dc-2b07-4467-8bde-76aff4f08022 tempest-AttachVolumeTestJSON-1518881454 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:06:54.144579 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 req-4023e5dc-2b07-4467-8bde-76aff4f08022 tempest-AttachVolumeTestJSON-1518881454 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.411s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:06:54.146786 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 req-4023e5dc-2b07-4467-8bde-76aff4f08022 tempest-AttachVolumeTestJSON-1518881454 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-39a9f446-bda4-412e-b835-f0b04d414fed', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '39a9f446-bda4-412e-b835-f0b04d414fed', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:06:54.185829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 req-4023e5dc-2b07-4467-8bde-76aff4f08022 tempest-AttachVolumeTestJSON-1518881454 None] Connection info returned from driver {'name': 'volumes/volume-39a9f446-bda4-412e-b835-f0b04d414fed', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '39a9f446-bda4-412e-b835-f0b04d414fed', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '879f9b2a-df67-4e73-a9be-659b37149155'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:06:54.316005 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-bbccac9a-3dd6-4e8e-9216-19f66c9b98b9 req-4023e5dc-2b07-4467-8bde-76aff4f08022 tempest-AttachVolumeTestJSON-1518881454 None] attachment_update completed successfully. Jan 15 21:06:57.203925 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:57.219800 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:57.220310 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:57.255405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Flow 'volume_create_manager' (955700cb-bbcc-4b05-9cb7-c560f0a80663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:57.265318 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d770c-1b11-4cb8-b0e5-253548c1c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:57.275377 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:57.296621 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d770c-1b11-4cb8-b0e5-253548c1c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-731825114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0f1d6d3-c0f9-4a5b-9db5-67840615d22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4dad65fccfe481a973f5fcbb9287dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:57Z,use_quota=True,user_id='6a6097506a2d4e36818310d9d70bf01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:57.311709 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cc00f4-b8b7-4933-9e98-392041072ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:57.327455 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cc00f4-b8b7-4933-9e98-392041072ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:57.341008 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355eb923-4805-447d-b549-5fb50e087b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:57.355381 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355eb923-4805-447d-b549-5fb50e087b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'volume_name': 'volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:57.371752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6af6771-6ba9-4f3f-a515-011aacbc0562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:57.382805 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6af6771-6ba9-4f3f-a515-011aacbc0562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:57.403705 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd3cb4b-9249-427c-ace5-027d5d48fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:57.406444 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Volume b0f1d6d3-c0f9-4a5b-9db5-67840615d22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'volume_size': 1} Jan 15 21:06:57.409060 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] creating volume 'volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:57.410785 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:57.529281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:57.530117 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:57.534844 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd3cb4b-9249-427c-ace5-027d5d48fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:57.550200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa4d667-2a0f-4d96-b12c-a70f83b80c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:57.575021 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Volume volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f (b0f1d6d3-c0f9-4a5b-9db5-67840615d22f): created successfully Jan 15 21:06:57.587157 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa4d667-2a0f-4d96-b12c-a70f83b80c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:57.595204 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Flow 'volume_create_manager' (955700cb-bbcc-4b05-9cb7-c560f0a80663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:57.607233 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4a71c3fa-b361-4562-8a61-ac12cd3de395 tempest-AttachVolumeTestJSON-1518881454 None] Created volume successfully. Jan 15 21:06:58.987935 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:06:59.002177 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:06:59.002640 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:06:59.076982 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Flow 'volume_create_manager' (0cfa360d-06a7-4264-b948-20974ec00eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:59.103448 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24502036-06ea-43ef-9fb8-c0af0f603890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:59.133481 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [req-478c6e87-12e3-4d84-8c77-b740193cab83 req-c7498167-cf2c-4438-bcb3-f7b58de9f832 tempest-AttachVolumeTestJSON-1518881454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:06:59.157071 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-478c6e87-12e3-4d84-8c77-b740193cab83 req-c7498167-cf2c-4438-bcb3-f7b58de9f832 tempest-AttachVolumeTestJSON-1518881454 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:06:59.257627 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24502036-06ea-43ef-9fb8-c0af0f603890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-795855396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36c2bab4-8235-4916-a7f3-a622be303f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55059fc8a93b4436a73495a81b82daa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:06:59Z,use_quota=True,user_id='f669648aa93741139cccd2fdea4df53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:59.264756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1461ec-11e4-4a3e-9d7e-b6a3a0d8a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:59.270239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1461ec-11e4-4a3e-9d7e-b6a3a0d8a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:59.277374 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565ff3ca-b8c7-4dc5-8137-549f52a67f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:59.283870 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565ff3ca-b8c7-4dc5-8137-549f52a67f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c2bab4-8235-4916-a7f3-a622be303f16', 'volume_name': 'volume-36c2bab4-8235-4916-a7f3-a622be303f16', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:59.290826 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc42e03-397c-4770-8e82-c2e778a20178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:59.296548 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc42e03-397c-4770-8e82-c2e778a20178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:59.303673 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba1534c-e3ab-4c38-9be9-309a817bbfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:59.305447 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Volume 36c2bab4-8235-4916-a7f3-a622be303f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c2bab4-8235-4916-a7f3-a622be303f16', 'volume_size': 1} Jan 15 21:06:59.306053 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] creating volume 'volume-36c2bab4-8235-4916-a7f3-a622be303f16' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:06:59.307488 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:06:59.455409 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:06:59.455824 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:06:59.460387 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba1534c-e3ab-4c38-9be9-309a817bbfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c2bab4-8235-4916-a7f3-a622be303f16', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:59.482403 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acaa599-2ba6-411c-8244-9c7ab6b39899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:06:59.511911 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Volume volume-36c2bab4-8235-4916-a7f3-a622be303f16 (36c2bab4-8235-4916-a7f3-a622be303f16): created successfully Jan 15 21:06:59.535040 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acaa599-2ba6-411c-8244-9c7ab6b39899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:06:59.568454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Flow 'volume_create_manager' (0cfa360d-06a7-4264-b948-20974ec00eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:06:59.582884 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-278470b3-defa-4486-b4ef-10bf5c76f2c7 tempest-VolumesListAdminTestJSON-296465975 None] Created volume successfully. Jan 15 21:07:00.598575 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-478c6e87-12e3-4d84-8c77-b740193cab83 req-c7498167-cf2c-4438-bcb3-f7b58de9f832 tempest-AttachVolumeTestJSON-1518881454 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.441s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:07:00.603297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-478c6e87-12e3-4d84-8c77-b740193cab83 req-c7498167-cf2c-4438-bcb3-f7b58de9f832 tempest-AttachVolumeTestJSON-1518881454 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:07:00.650753 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-478c6e87-12e3-4d84-8c77-b740193cab83 req-c7498167-cf2c-4438-bcb3-f7b58de9f832 tempest-AttachVolumeTestJSON-1518881454 None] Connection info returned from driver {'name': 'volumes/volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b0f1d6d3-c0f9-4a5b-9db5-67840615d22f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c0526f63-270f-4077-9d1a-9ace2e4170bc'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:07:00.815004 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-478c6e87-12e3-4d84-8c77-b740193cab83 req-c7498167-cf2c-4438-bcb3-f7b58de9f832 tempest-AttachVolumeTestJSON-1518881454 None] attachment_update completed successfully. Jan 15 21:07:00.848914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:00.869234 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:00.873986 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:00.931111 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Flow 'volume_create_manager' (5e5c7093-ad0a-428c-ae3f-fc5a56e630b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:00.951259 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91d15df-3397-4517-9d4e-2af98b9817d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:00.985902 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:01.040173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91d15df-3397-4517-9d4e-2af98b9817d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1852603707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=39c6954b-f67d-4f7d-8405-d2a49b264d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55059fc8a93b4436a73495a81b82daa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:01Z,use_quota=True,user_id='f669648aa93741139cccd2fdea4df53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:01.046229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df420ccb-db88-4020-b074-5b0f5686ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:01.052109 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df420ccb-db88-4020-b074-5b0f5686ea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:01.060373 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ddf7c9-8b10-4921-8ca0-0a7dc806a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:01.065978 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ddf7c9-8b10-4921-8ca0-0a7dc806a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c6954b-f67d-4f7d-8405-d2a49b264d23', 'volume_name': 'volume-39c6954b-f67d-4f7d-8405-d2a49b264d23', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:01.074550 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2119bfc6-17de-48ee-b89b-9d0ed699f70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:01.087643 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2119bfc6-17de-48ee-b89b-9d0ed699f70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:01.098257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f558abac-7886-4e29-a8a3-e88414835260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:01.100723 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Volume 39c6954b-f67d-4f7d-8405-d2a49b264d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c6954b-f67d-4f7d-8405-d2a49b264d23', 'volume_size': 1} Jan 15 21:07:01.101433 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] creating volume 'volume-39c6954b-f67d-4f7d-8405-d2a49b264d23' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:01.102720 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:01.246549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:01.246937 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:01.253972 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f558abac-7886-4e29-a8a3-e88414835260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c6954b-f67d-4f7d-8405-d2a49b264d23', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:01.270894 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f3262a-a776-4465-a302-b04c3ce55d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:01.296491 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Volume volume-39c6954b-f67d-4f7d-8405-d2a49b264d23 (39c6954b-f67d-4f7d-8405-d2a49b264d23): created successfully Jan 15 21:07:01.302541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f3262a-a776-4465-a302-b04c3ce55d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:01.331860 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Flow 'volume_create_manager' (5e5c7093-ad0a-428c-ae3f-fc5a56e630b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:01.349504 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3228d341-35a8-490c-9adf-8a2a4cacc5a3 tempest-VolumesListAdminTestJSON-296465975 None] Created volume successfully. Jan 15 21:07:02.333229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:02.340348 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:02.341171 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:02.374134 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Flow 'volume_create_manager' (9ad48439-4e6c-493f-b3b5-e5120615aeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:02.381524 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb7a9d7-602a-451e-aa30-3033ad2899ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:02.389059 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:02.413136 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb7a9d7-602a-451e-aa30-3033ad2899ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458767799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4cc715f-b6f8-42c8-b6e0-ea7177dae799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55059fc8a93b4436a73495a81b82daa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:02Z,use_quota=True,user_id='f669648aa93741139cccd2fdea4df53c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:02.419566 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb2bc1b-6aab-4480-9b8f-a40644dd11f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:02.424210 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb2bc1b-6aab-4480-9b8f-a40644dd11f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:02.433426 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67113cb-d1e3-426c-868d-5d5c6f02f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:02.437973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67113cb-d1e3-426c-868d-5d5c6f02f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4cc715f-b6f8-42c8-b6e0-ea7177dae799', 'volume_name': 'volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:02.445130 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a31ff7-e1e9-4a46-b867-e4e9ceebd56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:02.449611 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a31ff7-e1e9-4a46-b867-e4e9ceebd56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:02.455084 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc217a8-262d-4d3d-92f1-042397e941b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:02.456366 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Volume e4cc715f-b6f8-42c8-b6e0-ea7177dae799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799', 'volume_size': 1} Jan 15 21:07:02.456958 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] creating volume 'volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:02.458337 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:02.553873 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:02.554252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:02.558181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc217a8-262d-4d3d-92f1-042397e941b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:02.563828 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4add1e-0ec3-4f75-9357-134df70bca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:02.575740 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Volume volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799 (e4cc715f-b6f8-42c8-b6e0-ea7177dae799): created successfully Jan 15 21:07:02.583315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad4add1e-0ec3-4f75-9357-134df70bca6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:02.589920 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Flow 'volume_create_manager' (9ad48439-4e6c-493f-b3b5-e5120615aeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:02.598311 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-97f4b76e-e0ec-4287-9282-e6b61b5900ec tempest-VolumesListAdminTestJSON-296465975 None] Created volume successfully. Jan 15 21:07:04.085828 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:04.089045 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:04.089495 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:04.108971 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Flow 'volume_create_manager' (7b91a634-74ac-4ad4-8864-40eb2bf7f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:04.116169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071c1fc-7b78-4100-98ac-56a61205b6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:04.122705 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:04.137763 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9071c1fc-7b78-4100-98ac-56a61205b6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3dc462d-f2ab-4600-8016-6f7da0c4c383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03ae2ffa424d81aef1216680e72363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:04Z,use_quota=True,user_id='e5659f989b994200acff0042300a7f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:04.143841 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd81ac2-373d-41f1-9ca4-f1f1efc9fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:04.148549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd81ac2-373d-41f1-9ca4-f1f1efc9fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:04.153802 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc9ad71-d5b1-4b58-b289-959bb0852dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:04.158040 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc9ad71-d5b1-4b58-b289-959bb0852dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dc462d-f2ab-4600-8016-6f7da0c4c383', 'volume_name': 'volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:04.163641 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6339ebed-6051-4e58-8ecc-2c28c00f4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:04.167947 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6339ebed-6051-4e58-8ecc-2c28c00f4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:04.172738 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4712f4-869e-4c09-ab21-ce80452cb261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:04.173849 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Volume d3dc462d-f2ab-4600-8016-6f7da0c4c383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383', 'volume_size': 1} Jan 15 21:07:04.174243 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] creating volume 'volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:04.175217 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:04.230531 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:04.230984 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:04.234801 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4712f4-869e-4c09-ab21-ce80452cb261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:04.239421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48ac470-096e-48a6-96d9-5da3b46f1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:04.248532 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Volume volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383 (d3dc462d-f2ab-4600-8016-6f7da0c4c383): created successfully Jan 15 21:07:04.252096 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48ac470-096e-48a6-96d9-5da3b46f1a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:04.257637 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Flow 'volume_create_manager' (7b91a634-74ac-4ad4-8864-40eb2bf7f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:04.265319 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3bb363f8-a679-4ed2-9f1a-919ccd988c5f tempest-VolumesListAdminTestJSON-898275448 None] Created volume successfully. Jan 15 21:07:04.518408 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-ab008a09-c90c-40cb-bb27-a0594b3f56bd req-5a9ebce4-2bba-46d3-8dde-f254c1cdfc5d tempest-AttachVolumeTestJSON-1518881454 None] Terminate volume connection completed successfully. Jan 15 21:07:04.518916 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-ab008a09-c90c-40cb-bb27-a0594b3f56bd req-5a9ebce4-2bba-46d3-8dde-f254c1cdfc5d tempest-AttachVolumeTestJSON-1518881454 None] Deleting attachment 879f9b2a-df67-4e73-a9be-659b37149155. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:07:05.256589 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] Lock "b'cinder-d3dc462d-f2ab-4600-8016-6f7da0c4c383-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:05.284281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:05.369334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:05.369899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] Volume volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:05.376573 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] deleting rbd volume volume-d3dc462d-f2ab-4600-8016-6f7da0c4c383 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:05.400781 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] Lock "b'cinder-e4cc715f-b6f8-42c8-b6e0-ea7177dae799-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:05.440276 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:05.497266 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:05.498104 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] Volume volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:05.510258 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] deleting rbd volume volume-e4cc715f-b6f8-42c8-b6e0-ea7177dae799 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:05.657952 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] Created reservations ['b2584504-5b8c-48b3-885f-5045d3f08755', 'e94b5564-d3e7-43b5-9c4a-019bad91a7b2', 'ff929825-d5da-4859-8170-853d0e95e7b5', '77294496-2864-4f55-a993-89d5305182f8'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:05.708135 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:05.758169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:05.800250 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:05.807833 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] Deleted volume successfully. Jan 15 21:07:05.830452 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7c5dfea8-b72e-48fe-9bf2-e48dc72010fe tempest-VolumesListAdminTestJSON-898275448 None] Lock "b'cinder-d3dc462d-f2ab-4600-8016-6f7da0c4c383-delete_volume'" released by "delete_volume" :: held 0.574s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:05.862949 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] Created reservations ['dda5b71e-3a84-45d1-9297-644485ba25b0', '6857176f-625a-4475-a33b-494ca2e93cf1', 'bff3f2cb-8f3f-4fa0-a830-8be564c5e8c9', '6fdc451b-2b74-4fa3-893e-376be97ac737'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:05.904539 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 req-3de88fe6-8824-4b46-9263-37905247f5d6 tempest-AttachVolumeTestJSON-1518881454 None] Terminate volume connection completed successfully. Jan 15 21:07:05.905320 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-0e18055e-88dd-46ee-a31e-feaa8b9a0714 req-3de88fe6-8824-4b46-9263-37905247f5d6 tempest-AttachVolumeTestJSON-1518881454 None] Deleting attachment c0526f63-270f-4077-9d1a-9ace2e4170bc. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:07:05.934394 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:05.970812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:06.026969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:06.031566 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] Deleted volume successfully. Jan 15 21:07:06.048691 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2a170f28-635c-484b-ac2d-4dd3f6a556cd tempest-VolumesListAdminTestJSON-296465975 None] Lock "b'cinder-e4cc715f-b6f8-42c8-b6e0-ea7177dae799-delete_volume'" released by "delete_volume" :: held 0.648s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:06.496594 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] Lock "b'cinder-39c6954b-f67d-4f7d-8405-d2a49b264d23-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:06.579023 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:06.687921 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:06.688405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] Volume volume-39c6954b-f67d-4f7d-8405-d2a49b264d23 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:06.697634 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] deleting rbd volume volume-39c6954b-f67d-4f7d-8405-d2a49b264d23 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:07.052362 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] Created reservations ['ee78affb-a75c-4617-a6c5-bb217ae0a15f', '2763eca9-5053-4ef7-ab05-e45db8ed1012', 'fb19a83c-5a6e-4ce1-bd4c-af27e58d4803', 'b23ce76e-fe65-4284-b17f-bac6429f3185'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:07.108919 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:07.175161 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:07.274672 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:07.289591 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] Deleted volume successfully. Jan 15 21:07:07.313249 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e7d1f398-7447-4c42-8d84-8c27022e77b1 tempest-VolumesListAdminTestJSON-296465975 None] Lock "b'cinder-39c6954b-f67d-4f7d-8405-d2a49b264d23-delete_volume'" released by "delete_volume" :: held 0.817s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:07.682077 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] Lock "b'cinder-36c2bab4-8235-4916-a7f3-a622be303f16-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:07.718743 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:07.801412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:07.802080 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] Volume volume-36c2bab4-8235-4916-a7f3-a622be303f16 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:07.810722 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] deleting rbd volume volume-36c2bab4-8235-4916-a7f3-a622be303f16 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:08.134677 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] Created reservations ['32907e40-d17a-4d75-aa1c-16f16cb5730d', '401f490d-6b53-41b2-a97a-266b29bda111', '562b6fc7-f8e3-41e9-ab4b-cf720df5ae26', '3d6c1409-06ba-4be4-9778-afcd47dbfeeb'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:08.183006 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:08.220988 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:08.255086 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:08.259543 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] Deleted volume successfully. Jan 15 21:07:08.275088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-915f07ac-b726-4126-900f-c0b0f08fdfba tempest-VolumesListAdminTestJSON-296465975 None] Lock "b'cinder-36c2bab4-8235-4916-a7f3-a622be303f16-delete_volume'" released by "delete_volume" :: held 0.593s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:13.615119 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] Lock "b'cinder-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:13.675274 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:13.724992 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:13.725497 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] Volume volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:13.734047 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] deleting rbd volume volume-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:13.741874 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:13.746769 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:13.747288 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:13.771102 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Flow 'volume_create_manager' (c2b9023a-b391-4080-934c-da1dc4c907eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:13.779123 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e89b9-dabe-4cfb-a436-2629e2a778bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:13.791269 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:13.808516 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e89b9-dabe-4cfb-a436-2629e2a778bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1803633651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=639e1e2e-a156-4fab-b3b7-178b072079f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3b3507de8e4448a341ecdd4fda7846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:14Z,use_quota=True,user_id='31e90cdd50ed4672ba68f826f8591367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:13.814707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86a1d84-7e66-4ace-ac4e-e4e2abcd6326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:13.819712 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86a1d84-7e66-4ace-ac4e-e4e2abcd6326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:13.825504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572846f4-d029-48fc-aeb2-c8bc2dcbc472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:13.941882 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572846f4-d029-48fc-aeb2-c8bc2dcbc472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '639e1e2e-a156-4fab-b3b7-178b072079f2', 'volume_name': 'volume-639e1e2e-a156-4fab-b3b7-178b072079f2', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:13.950041 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dec3d6b-2350-4fa5-9c8f-a1af9263fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:13.955137 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dec3d6b-2350-4fa5-9c8f-a1af9263fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:13.960713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eb206a-9ddc-4cf6-8609-1acbc39bf4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:13.962151 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Volume 639e1e2e-a156-4fab-b3b7-178b072079f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-639e1e2e-a156-4fab-b3b7-178b072079f2', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:07:13.962927 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Cloning 639e1e2e-a156-4fab-b3b7-178b072079f2 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:07:13.982121 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:14.013511 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 7, 13, 995513)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:07:14.014111 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:07:14.015724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:07:14.024319 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.051s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:14.029308 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:07:14.055526 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 7, 14, 47023)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:07:14.055968 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:07:14.056415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:07:14.086117 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:14.164280 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] creating snapshot='volume-639e1e2e-a156-4fab-b3b7-178b072079f2.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:07:14.842417 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-639e1e2e-a156-4fab-b3b7-178b072079f2.clone_snap' to 'volume-639e1e2e-a156-4fab-b3b7-178b072079f2' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:07:14.889551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:14.895171 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:14.895659 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:14.929919 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Flow 'volume_create_manager' (c333078f-0795-40ca-8ef4-310d6175d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:14.942722 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074fd4f0-413b-4355-a1f6-62b3d6ecec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:14.952103 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:14.970502 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074fd4f0-413b-4355-a1f6-62b3d6ecec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-854825172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8eb74480-465c-4dac-bef0-e4932fe03475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e03e1de077453588cc783a4e6d690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:14Z,use_quota=True,user_id='822f4a2b1fd6459a8a472bdd066d69fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:14.978220 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a3064b-6ec0-4377-928c-5e041b2d6e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:14.984237 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a3064b-6ec0-4377-928c-5e041b2d6e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:14.990269 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a03a5-d04f-4bed-89b2-24957e8f8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:14.995683 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a03a5-d04f-4bed-89b2-24957e8f8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb74480-465c-4dac-bef0-e4932fe03475', 'volume_name': 'volume-8eb74480-465c-4dac-bef0-e4932fe03475', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:15.002806 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21582ea4-8f71-49fe-9319-6e98512a343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:15.007963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21582ea4-8f71-49fe-9319-6e98512a343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:15.012747 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e676f98c-13b6-4cf1-8d9a-6ccaed3e2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:15.013865 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Volume 8eb74480-465c-4dac-bef0-e4932fe03475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb74480-465c-4dac-bef0-e4932fe03475', 'volume_size': 1} Jan 15 21:07:15.014323 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] creating volume 'volume-8eb74480-465c-4dac-bef0-e4932fe03475' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:15.015888 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:15.103170 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:15.104822 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:15.105461 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:15.135214 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:07:15.136303 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Marking volume 639e1e2e-a156-4fab-b3b7-178b072079f2 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:07:15.150294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:15.151495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:15.159674 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e676f98c-13b6-4cf1-8d9a-6ccaed3e2261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb74480-465c-4dac-bef0-e4932fe03475', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:15.166027 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6e1a5d-ab30-4044-bfdd-9473dd7ff5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:15.189710 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] Created reservations ['3ce07b53-dd56-4323-b04a-af63308dce99', '86e3c202-417b-477b-b27f-990ed62b0416', '6e60d0ed-3af6-4d3d-b20a-f55fbe44dc11', '95d5ee53-1259-45c5-b445-5aae7d3d33da'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:15.199800 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 639e1e2e-a156-4fab-b3b7-178b072079f2. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:07:15.200817 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Creating volume glance metadata for volume 639e1e2e-a156-4fab-b3b7-178b072079f2 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:07:15.210101 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Volume volume-8eb74480-465c-4dac-bef0-e4932fe03475 (8eb74480-465c-4dac-bef0-e4932fe03475): created successfully Jan 15 21:07:15.219723 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6e1a5d-ab30-4044-bfdd-9473dd7ff5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:15.226021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Flow 'volume_create_manager' (c333078f-0795-40ca-8ef4-310d6175d49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:15.248594 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e41787fb-7693-4dd2-a8dc-c2132d61b738 tempest-AttachVolumeNegativeTest-2126621568 None] Created volume successfully. Jan 15 21:07:15.325724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:15.385243 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:15.428768 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:15.435799 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] Deleted volume successfully. Jan 15 21:07:15.451565 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eb206a-9ddc-4cf6-8609-1acbc39bf4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639e1e2e-a156-4fab-b3b7-178b072079f2', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:15.460425 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7549c9f-d74a-4076-80f6-d2a63e473b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:15.479236 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ee4a161d-992c-4133-9f86-e1536378c158 tempest-AttachVolumeTestJSON-1518881454 None] Lock "b'cinder-b0f1d6d3-c0f9-4a5b-9db5-67840615d22f-delete_volume'" released by "delete_volume" :: held 1.864s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:15.480870 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Volume volume-639e1e2e-a156-4fab-b3b7-178b072079f2 (639e1e2e-a156-4fab-b3b7-178b072079f2): created successfully Jan 15 21:07:15.485968 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7549c9f-d74a-4076-80f6-d2a63e473b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:15.496379 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Flow 'volume_create_manager' (c2b9023a-b391-4080-934c-da1dc4c907eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:15.507526 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3ac2e85a-01a5-4504-944b-127473854d48 tempest-VolumesImageMetadata-1796451264 None] Created volume successfully. Jan 15 21:07:15.964886 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] Lock "b'cinder-39a9f446-bda4-412e-b835-f0b04d414fed-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:16.010408 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:16.104357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:16.104791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] Volume volume-39a9f446-bda4-412e-b835-f0b04d414fed is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:16.114173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] deleting rbd volume volume-39a9f446-bda4-412e-b835-f0b04d414fed {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:16.213706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] Lock "b'cinder-639e1e2e-a156-4fab-b3b7-178b072079f2-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:16.288791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:16.408096 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:16.418044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] deleting rbd volume volume-639e1e2e-a156-4fab-b3b7-178b072079f2 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:16.505187 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] Created reservations ['21885a52-5c5c-43d4-ab0b-6cebc3538310', '3b98b6bf-efaa-4f7d-aa14-a8bd12f7850e', 'a88833b1-0aad-4399-bdb9-082336b2fc15', '074598f3-3565-4d87-8ef6-abe15a4d95a1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:16.570834 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:16.657088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:16.726318 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:16.732107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:07:16.774540 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] deleting parent snapshot volume-639e1e2e-a156-4fab-b3b7-178b072079f2.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:07:17.895210 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] Deleted volume successfully. Jan 15 21:07:17.918501 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 req-584f7608-adf8-4f21-bc82-bcde53280c49 tempest-AttachVolumeNegativeTest-2126621568 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:07:17.942344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] Lock "b'cinder-ca438ded-6045-415d-8f47-bda2befa2363-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:17.950021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b3365777-b02b-4e84-944c-5c62fc794353 tempest-AttachVolumeTestJSON-1518881454 None] Lock "b'cinder-39a9f446-bda4-412e-b835-f0b04d414fed-delete_volume'" released by "delete_volume" :: held 1.985s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:17.991254 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] Created reservations ['ad60fe7f-1923-4e04-87a6-b086c7d25d7e', 'd1b755b4-6ecb-45f2-9290-ce80b393b0f9', 'bb89d713-1cdd-45c3-a935-dc9dbfbb5ba7', '6f5f1450-28d8-4cb5-a818-642580114380'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:17.998832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:18.044265 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:18.044739 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] Volume volume-ca438ded-6045-415d-8f47-bda2befa2363 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:18.050882 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] deleting rbd volume volume-ca438ded-6045-415d-8f47-bda2befa2363 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:18.099726 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:18.160806 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:18.211324 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:18.216639 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] Deleted volume successfully. Jan 15 21:07:18.233622 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f0aac78-adcf-4f9c-8745-eaed73cdbec3 tempest-VolumesImageMetadata-1796451264 None] Lock "b'cinder-639e1e2e-a156-4fab-b3b7-178b072079f2-delete_volume'" released by "delete_volume" :: held 2.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:18.383044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] Created reservations ['6131a5bb-79f7-4a17-a4f5-6d3e69774c85', '7dfb816f-c743-4469-a494-f749631147e5', '17a1fe5b-a5b8-45b9-b816-7a2a3b296a99', 'e036f6c2-03a8-449e-b64c-eb47c4790a09'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:18.446370 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:18.523734 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:18.581329 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:18.585938 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] Deleted volume successfully. Jan 15 21:07:18.608329 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-5d03bc10-3327-4209-85ea-57cd9f12ef5c tempest-AttachVolumeTestJSON-1518881454 None] Lock "b'cinder-ca438ded-6045-415d-8f47-bda2befa2363-delete_volume'" released by "delete_volume" :: held 0.665s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:18.673885 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 req-584f7608-adf8-4f21-bc82-bcde53280c49 tempest-AttachVolumeNegativeTest-2126621568 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.756s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:07:18.674734 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 req-584f7608-adf8-4f21-bc82-bcde53280c49 tempest-AttachVolumeNegativeTest-2126621568 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8eb74480-465c-4dac-bef0-e4932fe03475', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '8eb74480-465c-4dac-bef0-e4932fe03475', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:07:18.699723 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 req-584f7608-adf8-4f21-bc82-bcde53280c49 tempest-AttachVolumeNegativeTest-2126621568 None] Connection info returned from driver {'name': 'volumes/volume-8eb74480-465c-4dac-bef0-e4932fe03475', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8eb74480-465c-4dac-bef0-e4932fe03475', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8812180b-e07b-43d0-bc1d-9472f3d3729b'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:07:18.784169 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3532bb33-30f8-48d5-a8b4-be15bd59a8f0 req-584f7608-adf8-4f21-bc82-bcde53280c49 tempest-AttachVolumeNegativeTest-2126621568 None] attachment_update completed successfully. Jan 15 21:07:22.149232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:22.156907 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:22.157733 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:22.186116 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Flow 'volume_create_manager' (4e50903c-ebcf-4b11-a680-ad241a67c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:22.199876 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd318961-e987-4556-a955-c32bf8bb3cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:22.211111 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:22.241055 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd318961-e987-4556-a955-c32bf8bb3cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-804952753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e93813ea-01cf-4a17-9609-0302fc89d2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af11ea4f30514b95b4a636e41190b0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:22Z,use_quota=True,user_id='90e20f0d63e748299ba201668fd4c7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:22.252566 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14de54a-ab92-4141-9700-d6925809f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:22.259015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14de54a-ab92-4141-9700-d6925809f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:22.266218 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c881f4b-21fc-4207-b2e7-99cda91b8cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:22.274455 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c881f4b-21fc-4207-b2e7-99cda91b8cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93813ea-01cf-4a17-9609-0302fc89d2cd', 'volume_name': 'volume-e93813ea-01cf-4a17-9609-0302fc89d2cd', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:22.279809 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01a5507-fb19-476f-a322-8d89ecd06fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:22.285082 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01a5507-fb19-476f-a322-8d89ecd06fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:22.293050 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47b4d7d-62af-4be9-a19f-9a2cf34d89b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:22.294765 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Volume e93813ea-01cf-4a17-9609-0302fc89d2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93813ea-01cf-4a17-9609-0302fc89d2cd', 'volume_size': 1} Jan 15 21:07:22.295344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] creating volume 'volume-e93813ea-01cf-4a17-9609-0302fc89d2cd' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:22.296503 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:22.421895 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:22.422464 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:22.428294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47b4d7d-62af-4be9-a19f-9a2cf34d89b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93813ea-01cf-4a17-9609-0302fc89d2cd', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:22.447420 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f1952e-14a5-4411-9700-7e10543a2a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:22.466094 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Volume volume-e93813ea-01cf-4a17-9609-0302fc89d2cd (e93813ea-01cf-4a17-9609-0302fc89d2cd): created successfully Jan 15 21:07:22.470935 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f1952e-14a5-4411-9700-7e10543a2a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:22.480337 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Flow 'volume_create_manager' (4e50903c-ebcf-4b11-a680-ad241a67c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:22.498969 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ea5b16d1-5305-4a94-9668-7c5a6618f0c0 tempest-VolumesTransfersV355Test-219829417 None] Created volume successfully. Jan 15 21:07:24.065563 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-19f49a15-e5a2-4951-b093-c8380c94e1da tempest-VolumesTransfersV355Test-2017140762 None] Transfer volume completed successfully. Jan 15 21:07:24.686992 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] Lock "b'cinder-e93813ea-01cf-4a17-9609-0302fc89d2cd-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:24.747371 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:24.841265 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:24.842376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] Volume volume-e93813ea-01cf-4a17-9609-0302fc89d2cd is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:24.852473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] deleting rbd volume volume-e93813ea-01cf-4a17-9609-0302fc89d2cd {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:25.301421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] Created reservations ['d678bebd-9423-4840-8939-4dac6346829a', 'ef4e1ab5-ceb0-49fe-8afb-26b576120c49', '5b6cc4f4-88b9-449a-982d-3867b0f25b0f', '90064fae-4e75-4f6c-82f6-e316b01fb791'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:25.419922 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:25.487201 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:25.539807 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:25.545292 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] Deleted volume successfully. Jan 15 21:07:25.568610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7bfc9274-3e03-4a84-b354-1d0b3861fced tempest-VolumesTransfersV355Test-1558828019 None] Lock "b'cinder-e93813ea-01cf-4a17-9609-0302fc89d2cd-delete_volume'" released by "delete_volume" :: held 0.881s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:26.324087 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:26.330507 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:26.330958 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:26.357727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Flow 'volume_create_manager' (57de54d7-8a41-46d8-8c7e-749f36ea4b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:26.366137 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b3e75d-60a1-435f-bb57-d9c4e2b76828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:26.374821 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:26.391124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b3e75d-60a1-435f-bb57-d9c4e2b76828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1471387544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=906e2e45-8994-420b-a104-b6b00ff2551d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af11ea4f30514b95b4a636e41190b0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:26Z,use_quota=True,user_id='90e20f0d63e748299ba201668fd4c7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:26.397275 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5283957c-428a-47ec-9c50-56febf5ebe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:26.401906 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5283957c-428a-47ec-9c50-56febf5ebe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:26.407176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec4436d-90f0-4552-9250-cc2017302d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:26.411715 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec4436d-90f0-4552-9250-cc2017302d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906e2e45-8994-420b-a104-b6b00ff2551d', 'volume_name': 'volume-906e2e45-8994-420b-a104-b6b00ff2551d', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:26.417010 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0a4584-1d9c-4932-9996-7d556b2b1da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:26.421929 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0a4584-1d9c-4932-9996-7d556b2b1da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:26.426694 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8c737-c554-4495-8a98-bce67d3dd5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:26.428205 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Volume 906e2e45-8994-420b-a104-b6b00ff2551d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906e2e45-8994-420b-a104-b6b00ff2551d', 'volume_size': 1} Jan 15 21:07:26.428600 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] creating volume 'volume-906e2e45-8994-420b-a104-b6b00ff2551d' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:26.429638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:26.527733 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:26.528258 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:26.532795 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8c737-c554-4495-8a98-bce67d3dd5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906e2e45-8994-420b-a104-b6b00ff2551d', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:26.541200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edcd74e-4b72-41cb-8c0e-b931496b39f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:26.552614 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Volume volume-906e2e45-8994-420b-a104-b6b00ff2551d (906e2e45-8994-420b-a104-b6b00ff2551d): created successfully Jan 15 21:07:26.557805 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edcd74e-4b72-41cb-8c0e-b931496b39f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:26.564670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Flow 'volume_create_manager' (57de54d7-8a41-46d8-8c7e-749f36ea4b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:26.582852 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-96a8f066-b09f-4a23-a9a5-f607bf54ebdb tempest-VolumesTransfersV355Test-219829417 None] Created volume successfully. Jan 15 21:07:27.905339 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] Lock "b'cinder-906e2e45-8994-420b-a104-b6b00ff2551d-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:27.956721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:28.029996 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:28.030507 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] Volume volume-906e2e45-8994-420b-a104-b6b00ff2551d is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:28.040784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] deleting rbd volume volume-906e2e45-8994-420b-a104-b6b00ff2551d {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:28.314857 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] Created reservations ['6576e299-9246-4ba6-bd41-60b64fd97d8e', '235ca51b-1e87-4f96-99f1-78f0c327c268', 'e12c9221-21e8-4c16-94b1-f1b8f0a2fca5', '307e5e93-2962-4271-a5dc-bc7d19b43851'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:28.363314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:28.408781 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:28.445042 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:28.450146 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] Deleted volume successfully. Jan 15 21:07:28.466506 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d4e54325-575e-4056-a2f1-ca08ef531d04 tempest-VolumesTransfersV355Test-1558828019 None] Lock "b'cinder-906e2e45-8994-420b-a104-b6b00ff2551d-delete_volume'" released by "delete_volume" :: held 0.562s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:35.988758 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-59921bc1-c83e-41f0-b94b-71631744fab9 req-d92ef4b7-b66b-4dc2-a516-064e6d78e35d tempest-AttachVolumeNegativeTest-2126621568 None] Terminate volume connection completed successfully. Jan 15 21:07:35.989575 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-59921bc1-c83e-41f0-b94b-71631744fab9 req-d92ef4b7-b66b-4dc2-a516-064e6d78e35d tempest-AttachVolumeNegativeTest-2126621568 None] Deleting attachment 8812180b-e07b-43d0-bc1d-9472f3d3729b. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:07:38.545610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:38.555483 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:38.559403 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:38.610337 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (09727b57-80c0-4870-9e59-f8361b733f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:38.629707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde73d5e-ac79-4f9d-a598-4a9322300477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:38.644135 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:38.668475 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde73d5e-ac79-4f9d-a598-4a9322300477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349767030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=54e36e7f-6e75-428b-97f3-c673d414e0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa736a1907e4790b2ea49bc7f31e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:38Z,use_quota=True,user_id='6d2364cc12914bd3922a66feb86c5c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:38.685054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0dfff2-49d4-4f4f-b0da-d5aa49016715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:38.695221 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0dfff2-49d4-4f4f-b0da-d5aa49016715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:38.712039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd9c02-9b9f-4fd6-9557-4b7f43311738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:38.720365 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd9c02-9b9f-4fd6-9557-4b7f43311738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e36e7f-6e75-428b-97f3-c673d414e0e9', 'volume_name': 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:38.732751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fb1292-2df2-4885-8324-5e0b5b0cd501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:38.748015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fb1292-2df2-4885-8324-5e0b5b0cd501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:38.753078 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e295d373-6329-437e-99e1-ca4972fb7bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:38.759670 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Volume 54e36e7f-6e75-428b-97f3-c673d414e0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9', 'volume_size': 1} Jan 15 21:07:38.763283 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] creating volume 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:38.764966 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:38.894097 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:38.894974 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:38.900043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e295d373-6329-437e-99e1-ca4972fb7bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e36e7f-6e75-428b-97f3-c673d414e0e9', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:38.912405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066be61a-c369-4bc2-8fc1-e9dc151aa866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:38.935978 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-54e36e7f-6e75-428b-97f3-c673d414e0e9 (54e36e7f-6e75-428b-97f3-c673d414e0e9): created successfully Jan 15 21:07:38.946237 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066be61a-c369-4bc2-8fc1-e9dc151aa866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:38.956374 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (09727b57-80c0-4870-9e59-f8361b733f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:38.971797 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8eb9f50b-2b15-4687-b9d2-e4c1150a60b5 tempest-VolumesSnapshotTestJSON-711254379 None] Created volume successfully. Jan 15 21:07:39.223604 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 req-3dafe2e3-bad5-4fce-91fe-a58f7b82d9a2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Terminate volume connection completed successfully. Jan 15 21:07:39.225306 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 req-3dafe2e3-bad5-4fce-91fe-a58f7b82d9a2 tempest-TaggedBootDevicesTest_v242-1223982624 None] Deleting attachment 97fc20a9-7348-49b0-8692-51b095279aaa. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:07:39.535059 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 req-00d577e0-01be-419c-8972-f36710a2d038 tempest-TaggedBootDevicesTest_v242-1223982624 None] Terminate volume connection completed successfully. Jan 15 21:07:39.535934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 req-00d577e0-01be-419c-8972-f36710a2d038 tempest-TaggedBootDevicesTest_v242-1223982624 None] Deleting attachment 3c18d66a-693f-4618-b369-d0d344b96633. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:07:39.745718 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 req-e3a518d4-9801-42c1-89dc-f9e1fa2267ae tempest-TaggedBootDevicesTest_v242-1223982624 None] Terminate volume connection completed successfully. Jan 15 21:07:39.746747 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d3c9dbdb-7bee-47b3-82ee-b3f02a3ad3a5 req-e3a518d4-9801-42c1-89dc-f9e1fa2267ae tempest-TaggedBootDevicesTest_v242-1223982624 None] Deleting attachment 900888f1-2515-41f5-9ae5-3bf7b725321c. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:07:39.926257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1b7ef586-6405-4253-b163-500ce785cc7f tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:40.987696 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1b7ef586-6405-4253-b163-500ce785cc7f tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:07:41.309120 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:07:41.309907 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:41.385934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:41.450257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:42.620245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.driver [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Creating a new backup for volume volume-54e36e7f-6e75-428b-97f3-c673d414e0e9. {{(pid=122725) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Jan 15 21:07:42.666582 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] cloning volumes/volume-54e36e7f-6e75-428b-97f3-c673d414e0e9@snapshot-83fca79f-1c91-4238-a0ac-c224626f75a2 to volume-36d57237-7f3c-49f3-b497-9bd3e60acad2 {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:07:42.667496 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:42.774334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:42.930059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:42.930928 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:42.936629 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:42.990509 ncdv-master-1 cinder-volume[122725]: WARNING cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Jan 15 21:07:43.057353 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:07:43.811189 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.754s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:07:43.812884 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-36d57237-7f3c-49f3-b497-9bd3e60acad2', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '36d57237-7f3c-49f3-b497-9bd3e60acad2', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:07:43.835086 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Initialize volume connection completed successfully. Jan 15 21:07:47.791171 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-efb00e0a-c1d0-490c-b037-a9ff38a1ecac-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:47.917571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:48.009437 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:48.010128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:48.018438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] deleting rbd volume volume-efb00e0a-c1d0-490c-b037-a9ff38a1ecac {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:48.418047 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] Created reservations ['f9c1178e-8802-4091-a2f5-d4c8a0ec1ecf', 'b45c0948-b144-4eb4-8ce7-d007d1e24215', '09f5954e-7fdd-4e8d-9bb2-ec866b36b97c', 'cfced033-1e3b-48da-8cc0-c9d3e799ec7e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:48.501718 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:48.598271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:48.655132 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:48.659525 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] Deleted volume successfully. Jan 15 21:07:48.680981 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3e4b0c36-1244-4cd1-96dc-d01905eb95d9 tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-efb00e0a-c1d0-490c-b037-a9ff38a1ecac-delete_volume'" released by "delete_volume" :: held 0.890s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:49.265290 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8-delete_volume'" acquired by "delete_volume" :: waited 0.058s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:49.426214 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:49.650144 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:49.650916 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] Volume volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:49.669635 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] deleting rbd volume volume-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:50.081665 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] Created reservations ['ac40f32a-203a-48a6-971a-d521bb9436ae', '8700ebc6-f71b-43f4-9b7c-1d010200b374', '72a69552-71d4-430c-9113-b9d07599f955', 'd1f930cc-ef3a-409d-a782-188feaf12da1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:50.154348 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:50.216716 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:50.274297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:50.296292 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] Deleted volume successfully. Jan 15 21:07:50.326965 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-172353ff-19be-4123-85de-a5e158f29907 tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-c24f9c1b-c425-47b2-b6ea-c6857a68ebe8-delete_volume'" released by "delete_volume" :: held 1.062s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:50.604859 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-a68031b5-01be-4dd2-bc8c-bd643fdc53d4-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:50.679578 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:50.878734 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:50.916736 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] deleting rbd volume volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:51.454827 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:07:51.492271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] deleting parent snapshot volume-a68031b5-01be-4dd2-bc8c-bd643fdc53d4.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:07:52.602092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] Created reservations ['d4b46a0f-7012-4803-bb14-97c7b72e6c51', '272e053a-f722-4c22-afbe-977b83ec6676', '18ae0208-425f-46d8-9474-12623e7d6fa8', '5a5708b1-e49a-4737-8068-0bcfae577547'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:52.698291 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:52.768380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:52.862120 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:52.866943 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] Deleted volume successfully. Jan 15 21:07:52.890231 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d0fe657f-1d4b-49fe-ad4b-47d343982d2b tempest-TaggedBootDevicesTest_v242-1223982624 None] Lock "b'cinder-a68031b5-01be-4dd2-bc8c-bd643fdc53d4-delete_volume'" released by "delete_volume" :: held 2.286s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:56.456976 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:07:56.466215 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:07:56.474006 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:07:56.548145 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Flow 'volume_create_manager' (ebe63eb1-b58b-4e23-9b8c-0f1cc8294c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:56.572488 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7862c833-5995-4269-9471-f05a38b70900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:56.583422 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:07:56.612770 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7862c833-5995-4269-9471-f05a38b70900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018693379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9dd562f9-7a3d-489b-8619-26ee0403ebb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e03e1de077453588cc783a4e6d690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:07:56Z,use_quota=True,user_id='822f4a2b1fd6459a8a472bdd066d69fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:56.620083 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c86bf57-2f2f-4838-a217-1e778b7e030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:56.625327 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c86bf57-2f2f-4838-a217-1e778b7e030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:56.632914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601ec489-4070-418e-8777-205db3928886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:56.641746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601ec489-4070-418e-8777-205db3928886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'volume_name': 'volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:56.656608 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd05a485-96f2-4026-acc0-bd23509c245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:56.671137 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd05a485-96f2-4026-acc0-bd23509c245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:56.682951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd1dc39-be07-4ca4-83a9-be3afe117922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:56.685408 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Volume 9dd562f9-7a3d-489b-8619-26ee0403ebb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'volume_size': 1} Jan 15 21:07:56.687400 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] creating volume 'volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:07:56.689889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:56.842759 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Terminate volume connection completed successfully. Jan 15 21:07:56.871104 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:07:56.871882 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:07:56.885425 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd1dc39-be07-4ca4-83a9-be3afe117922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:56.901828 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1baa6199-87a7-48ce-9270-cd6ca1d2e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:07:56.933098 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Volume volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9 (9dd562f9-7a3d-489b-8619-26ee0403ebb9): created successfully Jan 15 21:07:56.941627 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1baa6199-87a7-48ce-9270-cd6ca1d2e17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:07:56.955891 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Flow 'volume_create_manager' (ebe63eb1-b58b-4e23-9b8c-0f1cc8294c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:07:56.981802 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Remove volume export completed successfully. Jan 15 21:07:56.984145 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-41f0e0e3-1d68-4741-ac08-fe43def21453 tempest-AttachVolumeNegativeTest-2126621568 None] Created volume successfully. Jan 15 21:07:57.068439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-36d57237-7f3c-49f3-b497-9bd3e60acad2-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:57.105329 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:57.237718 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:57.248271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-36d57237-7f3c-49f3-b497-9bd3e60acad2 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:57.279521 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] Lock "b'cinder-e452f945-747c-45ae-b549-0903752da1dd-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:57.349926 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:57.447098 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:57.448393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] Volume volume-e452f945-747c-45ae-b549-0903752da1dd is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:57.457804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] deleting rbd volume volume-e452f945-747c-45ae-b549-0903752da1dd {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:57.671700 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:07:57.684957 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f49605b-c4e8-490d-9c70-aefb1e4ed40e tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-36d57237-7f3c-49f3-b497-9bd3e60acad2-delete_volume'" released by "delete_volume" :: held 0.616s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:57.905887 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] Created reservations ['c0e7f2c6-d58e-4933-b0d3-9c984bdfcb30', '1809feee-83f4-43ff-b639-1fcfe6f7604d', '2bba709b-16f3-48e5-b606-0da55f39f87e', '89cd2361-6a1e-43c6-9128-2bf3d55a22dd'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:58.054813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:58.134242 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:58.237088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:58.250004 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] Deleted volume successfully. Jan 15 21:07:58.272383 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b70fc622-4d37-412e-bd12-57afcaf6ca64 tempest-AttachVolumeShelveTestJSON-72753905 None] Lock "b'cinder-e452f945-747c-45ae-b549-0903752da1dd-delete_volume'" released by "delete_volume" :: held 0.993s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:07:58.524224 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-c9508fda-6696-44be-a779-77b043360c5d req-9c3422e7-8068-436a-ac5b-8be1c96cd154 tempest-AttachVolumeNegativeTest-2126621568 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:07:58.737310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] Lock "b'cinder-0cd4da7e-0abd-4d64-b27e-2f3b80099824-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:07:58.869577 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:59.009851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:07:59.010422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] Volume volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:07:59.038295 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] deleting rbd volume volume-0cd4da7e-0abd-4d64-b27e-2f3b80099824 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:07:59.604752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] Created reservations ['d3e7d742-b049-4fcc-b25d-146603c6ecb0', 'ac98316f-7476-4bb7-93e9-d27839fad38e', '33009958-6289-469b-8c8b-d6ba339faff3', '3fadabcf-f9ef-4026-aefc-f8771a446356'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:07:59.718685 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:59.802203 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:07:59.867345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:07:59.876946 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] Deleted volume successfully. Jan 15 21:07:59.913455 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f3604c25-888f-4735-90f4-8fa61d6f3971 tempest-AttachVolumeShelveTestJSON-72753905 None] Lock "b'cinder-0cd4da7e-0abd-4d64-b27e-2f3b80099824-delete_volume'" released by "delete_volume" :: held 1.186s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:08:00.544605 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-c9508fda-6696-44be-a779-77b043360c5d req-9c3422e7-8068-436a-ac5b-8be1c96cd154 tempest-AttachVolumeNegativeTest-2126621568 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.021s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:08:00.545605 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-c9508fda-6696-44be-a779-77b043360c5d req-9c3422e7-8068-436a-ac5b-8be1c96cd154 tempest-AttachVolumeNegativeTest-2126621568 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:08:00.584084 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-c9508fda-6696-44be-a779-77b043360c5d req-9c3422e7-8068-436a-ac5b-8be1c96cd154 tempest-AttachVolumeNegativeTest-2126621568 None] Connection info returned from driver {'name': 'volumes/volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9dd562f9-7a3d-489b-8619-26ee0403ebb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e5aa3c0e-5786-4cbf-9488-1b9eccbb89aa'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:08:00.714820 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-c9508fda-6696-44be-a779-77b043360c5d req-9c3422e7-8068-436a-ac5b-8be1c96cd154 tempest-AttachVolumeNegativeTest-2126621568 None] attachment_update completed successfully. Jan 15 21:08:03.916547 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e295736e-c093-4e20-b2d5-279342d91f7d req-67306157-b68b-44a7-89b4-08742d0b1972 tempest-AttachVolumeNegativeTest-2126621568 None] Terminate volume connection completed successfully. Jan 15 21:08:03.918010 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e295736e-c093-4e20-b2d5-279342d91f7d req-67306157-b68b-44a7-89b4-08742d0b1972 tempest-AttachVolumeNegativeTest-2126621568 None] Deleting attachment e5aa3c0e-5786-4cbf-9488-1b9eccbb89aa. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:08:24.453051 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:08:24.468681 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:08:24.472640 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:08:24.558388 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (3b93b7d4-d487-4b1f-af53-327ded029985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:08:24.570395 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ee78e0-c383-46d2-b119-f3f4ee337bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:24.598300 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:08:24.615663 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ee78e0-c383-46d2-b119-f3f4ee337bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2129223646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1df1f210-c337-4c2c-9ab2-6ce7c8ff1134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa736a1907e4790b2ea49bc7f31e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:08:24Z,use_quota=True,user_id='6d2364cc12914bd3922a66feb86c5c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:24.623889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7bc2f7-ab93-4576-9323-bed41b6b7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:24.635727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7bc2f7-ab93-4576-9323-bed41b6b7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:24.643250 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3986de88-71ca-4bf2-8f00-aa54dc199603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:24.774584 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3986de88-71ca-4bf2-8f00-aa54dc199603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'volume_name': 'volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:24.779758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbdab41-c35b-4ce2-9418-b4d1253ac958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:24.784682 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbdab41-c35b-4ce2-9418-b4d1253ac958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:24.792244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cbffa-1366-4dde-8394-73eed4708fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:24.794689 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Volume 1df1f210-c337-4c2c-9ab2-6ce7c8ff1134: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:08:24.795582 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Cloning 1df1f210-c337-4c2c-9ab2-6ce7c8ff1134 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:08:24.813888 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:08:24.830392 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 8, 24, 819511)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:08:24.832046 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:08:24.832464 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:08:24.844995 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:08:24.848244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:08:24.859628 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 8, 24, 855609)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:08:24.860052 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:08:24.863113 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:08:24.880721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:25.000458 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] creating snapshot='volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:08:25.305607 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134.clone_snap' to 'volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:08:25.568531 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:08:25.570277 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:08:25.570808 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:08:25.606565 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:08:25.607256 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Marking volume 1df1f210-c337-4c2c-9ab2-6ce7c8ff1134 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:08:25.619062 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 1df1f210-c337-4c2c-9ab2-6ce7c8ff1134. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:08:25.619706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Creating volume glance metadata for volume 1df1f210-c337-4c2c-9ab2-6ce7c8ff1134 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:08:25.772380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cbffa-1366-4dde-8394-73eed4708fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:25.779999 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333cd818-114d-4756-b3e8-b9fddcc5c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:25.799195 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134 (1df1f210-c337-4c2c-9ab2-6ce7c8ff1134): created successfully Jan 15 21:08:25.805989 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333cd818-114d-4756-b3e8-b9fddcc5c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:25.819206 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (3b93b7d4-d487-4b1f-af53-327ded029985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:08:25.829857 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-fbb94313-46b4-457f-bbe3-c1b72080ee27 tempest-VolumesSnapshotTestJSON-711254379 None] Created volume successfully. Jan 15 21:08:26.706559 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:08:26.726639 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:08:26.727637 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:08:26.752941 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Flow 'volume_create_manager' (28454c4d-144b-430a-8221-b0c255cd1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:08:26.763127 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953f0cca-d47b-492a-99b2-a99a081d663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:26.770736 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:08:26.797128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953f0cca-d47b-492a-99b2-a99a081d663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-280204076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f739d784-56d6-47b6-a3a0-4b21da8e89e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e03e1de077453588cc783a4e6d690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:08:27Z,use_quota=True,user_id='822f4a2b1fd6459a8a472bdd066d69fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:26.806049 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b279ed70-92b6-4f5f-b67f-6bb69f86e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:26.810696 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b279ed70-92b6-4f5f-b67f-6bb69f86e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:26.818804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74802f81-86af-4327-99e5-f7b85c499926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:26.823454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74802f81-86af-4327-99e5-f7b85c499926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'volume_name': 'volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:26.828590 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189d858a-4339-40a1-b055-d1bf5cc83d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:26.833244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189d858a-4339-40a1-b055-d1bf5cc83d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:26.841551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3142e516-48cd-46cc-8b3c-5dd186de32d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:26.842896 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Volume f739d784-56d6-47b6-a3a0-4b21da8e89e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'volume_size': 1} Jan 15 21:08:26.843343 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] creating volume 'volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:08:26.844610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:26.947281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:08:26.948255 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:08:26.953827 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3142e516-48cd-46cc-8b3c-5dd186de32d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:26.966644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f41a73-b236-4edb-af40-dfe40c91a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:26.984416 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Volume volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8 (f739d784-56d6-47b6-a3a0-4b21da8e89e8): created successfully Jan 15 21:08:26.997529 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f41a73-b236-4edb-af40-dfe40c91a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:27.011076 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Flow 'volume_create_manager' (28454c4d-144b-430a-8221-b0c255cd1906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:08:27.036000 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-04e1a794-56ea-4c0a-893c-5c9d38a64828 tempest-AttachVolumeNegativeTest-2126621568 None] Created volume successfully. Jan 15 21:08:27.368769 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 req-0d51280a-536b-4b28-83a1-ae907153bc60 tempest-VolumesSnapshotTestJSON-711254379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:08:28.615035 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 req-0d51280a-536b-4b28-83a1-ae907153bc60 tempest-VolumesSnapshotTestJSON-711254379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.246s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:08:28.615957 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 req-0d51280a-536b-4b28-83a1-ae907153bc60 tempest-VolumesSnapshotTestJSON-711254379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:08:28.647370 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 req-0d51280a-536b-4b28-83a1-ae907153bc60 tempest-VolumesSnapshotTestJSON-711254379 None] Connection info returned from driver {'name': 'volumes/volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1df1f210-c337-4c2c-9ab2-6ce7c8ff1134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '68aaba95-3172-442a-8a34-e95ccfffc0d6'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:08:28.772641 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 req-a5dcf2e2-50e9-4163-be07-6775ae61d8da tempest-AttachVolumeNegativeTest-2126621568 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:08:28.901956 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-c61e2f5f-41e5-4354-8ae6-2c0f3919b517 req-0d51280a-536b-4b28-83a1-ae907153bc60 tempest-VolumesSnapshotTestJSON-711254379 None] attachment_update completed successfully. Jan 15 21:08:30.192058 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 req-a5dcf2e2-50e9-4163-be07-6775ae61d8da tempest-AttachVolumeNegativeTest-2126621568 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.420s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:08:30.193683 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 req-a5dcf2e2-50e9-4163-be07-6775ae61d8da tempest-AttachVolumeNegativeTest-2126621568 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:08:30.237699 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 req-a5dcf2e2-50e9-4163-be07-6775ae61d8da tempest-AttachVolumeNegativeTest-2126621568 None] Connection info returned from driver {'name': 'volumes/volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f739d784-56d6-47b6-a3a0-4b21da8e89e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '89e8bf5f-04e5-4d28-880b-0a1d3f3f54f9'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:08:30.403053 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-36d8e9e0-ec17-4c69-b547-0777f09b6b91 req-a5dcf2e2-50e9-4163-be07-6775ae61d8da tempest-AttachVolumeNegativeTest-2126621568 None] attachment_update completed successfully. Jan 15 21:08:31.080180 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9e0a9fc5-1f48-40dd-b6eb-9af2b42ce8bc tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:31.453523 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9e0a9fc5-1f48-40dd-b6eb-9af2b42ce8bc tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:08:32.424306 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-60bd97a5-a0a1-4a5d-9252-844bf31b4089 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:33.031427 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 req-eb5ebd9e-2515-4d99-9248-b5fb5bc3a9c4 tempest-AttachVolumeNegativeTest-2126621568 None] Terminate volume connection completed successfully. Jan 15 21:08:33.035142 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d1e262b4-9a7f-4a61-b34b-d5bbbb17fef1 req-eb5ebd9e-2515-4d99-9248-b5fb5bc3a9c4 tempest-AttachVolumeNegativeTest-2126621568 None] Deleting attachment 89e8bf5f-04e5-4d28-880b-0a1d3f3f54f9. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:08:33.457659 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-60bd97a5-a0a1-4a5d-9252-844bf31b4089 tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:08:33.760192 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] Lock "b'cinder-f739d784-56d6-47b6-a3a0-4b21da8e89e8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:08:33.821910 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:33.902314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:08:33.903135 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] Volume volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:08:33.914538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] deleting rbd volume volume-f739d784-56d6-47b6-a3a0-4b21da8e89e8 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:08:34.322601 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] Created reservations ['3655c388-7863-4d47-b1e8-b9e01b71aa22', '470a4014-22b3-473b-81e9-4ab03c49c07c', '641b86a7-065e-4ad7-b3d3-a66376def53f', '741a0fba-11f5-466f-a6d7-959c034b905f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:08:34.405297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:34.501031 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:34.570954 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:08:34.575679 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] Deleted volume successfully. Jan 15 21:08:34.597303 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ddaae43b-231a-4fac-8e6f-84999bcec876 tempest-AttachVolumeNegativeTest-2126621568 None] Lock "b'cinder-f739d784-56d6-47b6-a3a0-4b21da8e89e8-delete_volume'" released by "delete_volume" :: held 0.837s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:08:34.860173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-60f62cc8-135a-47a4-82a3-d9922dbc3526 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:35.499540 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-60f62cc8-135a-47a4-82a3-d9922dbc3526 tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:08:35.987307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-65e3242a-0761-4985-8b43-fd369e4f9ce0 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-2f6acdb0-2bad-4dd1-a62e-198080d4683e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:08:35.992072 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-65e3242a-0761-4985-8b43-fd369e4f9ce0 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:40.420492 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] Lock "b'cinder-9dd562f9-7a3d-489b-8619-26ee0403ebb9-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:08:40.492495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:40.556095 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:08:40.556795 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] Volume volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:08:40.565378 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] deleting rbd volume volume-9dd562f9-7a3d-489b-8619-26ee0403ebb9 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:08:40.835689 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] Created reservations ['556d11b7-92af-44db-ad6b-2a0b694efedc', '652e4ceb-7743-4be1-9a4e-ee268fd2da80', '4b90b6b4-969f-4c35-a35c-d0052ef20c90', '9912e707-fdec-4820-b119-e04e8905374d'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:08:40.892531 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:40.921466 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:40.961397 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:08:40.969190 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] Deleted volume successfully. Jan 15 21:08:40.986051 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-913227f3-f234-46b6-9f77-76b09c51bede tempest-AttachVolumeNegativeTest-2126621568 None] Lock "b'cinder-9dd562f9-7a3d-489b-8619-26ee0403ebb9-delete_volume'" released by "delete_volume" :: held 0.567s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:08:41.308207 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:08:41.309122 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:41.361897 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:41.409926 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:08:49.570573 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] Lock "b'cinder-8eb74480-465c-4dac-bef0-e4932fe03475-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:08:49.632699 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:49.686039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:08:49.686698 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] Volume volume-8eb74480-465c-4dac-bef0-e4932fe03475 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:08:49.695541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] deleting rbd volume volume-8eb74480-465c-4dac-bef0-e4932fe03475 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:08:49.981725 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] Created reservations ['e7affbdd-fdaf-400d-8207-177f641cdf1d', 'a79bcd1b-5c9c-4cfa-ade2-ba2edaec7daa', '1589e660-8d76-4134-a119-d01dabf0481b', '7d8faadb-6b09-445e-9c1d-b3404beefd70'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:08:50.040262 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:50.075666 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:50.125617 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:08:50.134623 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] Deleted volume successfully. Jan 15 21:08:50.154906 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-03154d24-59e1-4acf-b1bc-fa7abf291fd3 tempest-AttachVolumeNegativeTest-2126621568 None] Lock "b'cinder-8eb74480-465c-4dac-bef0-e4932fe03475-delete_volume'" released by "delete_volume" :: held 0.585s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:08:56.528014 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9b86b70a-b7f7-4db1-a1ee-8c4aa2684063 tempest-GroupSnapshotsV319Test-1250779715 None] Group tempest-GroupSnapshotsV319Test-Group-63406925: creating Jan 15 21:08:56.561451 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9b86b70a-b7f7-4db1-a1ee-8c4aa2684063 tempest-GroupSnapshotsV319Test-1250779715 None] Group tempest-GroupSnapshotsV319Test-Group-63406925: created successfully Jan 15 21:08:56.572637 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9b86b70a-b7f7-4db1-a1ee-8c4aa2684063 tempest-GroupSnapshotsV319Test-1250779715 None] Create group completed successfully. Jan 15 21:08:58.116139 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:08:58.120746 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:08:58.121297 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:08:58.154869 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Flow 'volume_create_manager' (14b29400-6a13-48a3-82a4-73734f9859d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:08:58.162383 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06969ab1-e434-4f35-a39a-0f7d824d53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:58.170300 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:08:58.185310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06969ab1-e434-4f35-a39a-0f7d824d53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-235117720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b3ba073-d244-4301-8e6a-0a476a48f17f,host='ncdv-master-1@ceph#ceph',id=c1dcb2a8-4739-4142-9881-267b03aa7cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b66e292684b4012b831521cc68badaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:08:58Z,use_quota=True,user_id='24ec9bc0d30843fc9052ca2feddf3d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abcc716c-0603-47cc-8648-7f197db65dbb),volume_type_id=abcc716c-0603-47cc-8648-7f197db65dbb)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:58.191646 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758647c9-f12b-4bed-84ea-bc1d836a249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:58.202284 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758647c9-f12b-4bed-84ea-bc1d836a249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:58.211254 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0680c92-4d31-4b1a-ac0c-0d4b352b3d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:58.216980 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0680c92-4d31-4b1a-ac0c-0d4b352b3d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1dcb2a8-4739-4142-9881-267b03aa7cfd', 'volume_name': 'volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:58.224216 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b993e4-a271-4a18-9537-ae02353395d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:58.228684 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b993e4-a271-4a18-9537-ae02353395d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:58.234037 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a7f3ba-7e6a-4b4f-8c2a-e1c407da8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:58.235570 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Volume c1dcb2a8-4739-4142-9881-267b03aa7cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd', 'volume_size': 1} Jan 15 21:08:58.236448 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] creating volume 'volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:08:58.237703 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:08:58.354571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:08:58.355286 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:08:58.364956 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a7f3ba-7e6a-4b4f-8c2a-e1c407da8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:58.378107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f67f60-092a-4611-bcef-f18f48862418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:08:58.400995 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Volume volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd (c1dcb2a8-4739-4142-9881-267b03aa7cfd): created successfully Jan 15 21:08:58.412054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f67f60-092a-4611-bcef-f18f48862418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:08:58.426616 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Flow 'volume_create_manager' (14b29400-6a13-48a3-82a4-73734f9859d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:08:58.440344 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-96df11dc-af7a-4bde-bfa1-cd6c9a65b22e tempest-GroupSnapshotsV319Test-1250779715 None] Created volume successfully. Jan 15 21:08:59.528194 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-25607bc8-f808-4e09-ab58-35656f17b469 tempest-GroupSnapshotsV319Test-1250779715 None] GroupSnapshot 4d33b413-a033-4aa6-9d33-fb65a345c647: creating. Jan 15 21:08:59.585977 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-25607bc8-f808-4e09-ab58-35656f17b469 tempest-GroupSnapshotsV319Test-1250779715 None] Group snapshot 4d33b413-a033-4aa6-9d33-fb65a345c647: creating. {{(pid=122725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Jan 15 21:08:59.605427 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-25607bc8-f808-4e09-ab58-35656f17b469 tempest-GroupSnapshotsV319Test-1250779715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:00.127980 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-25607bc8-f808-4e09-ab58-35656f17b469 tempest-GroupSnapshotsV319Test-1250779715 None] group_snapshot 4d33b413-a033-4aa6-9d33-fb65a345c647: created successfully Jan 15 21:09:01.134804 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] group_snapshot 4d33b413-a033-4aa6-9d33-fb65a345c647: deleting Jan 15 21:09:01.155001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] group_snapshot 4d33b413-a033-4aa6-9d33-fb65a345c647: deleting {{(pid=122725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Jan 15 21:09:01.172583 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:02.111743 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1512092601 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1512092601, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:09:02.112798 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1512092601 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1512092601, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:09:02.131983 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] Created reservations ['418ffd19-806b-4ea5-ad38-33581cd09118', '051b8828-0cd3-4bcd-9b5e-574377f7d524', '9d7c2485-37d6-4ea0-b4c0-874d2fac3d2a', 'e10b75ba-71f1-40fa-bc02-b60d92936bdd'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:02.187134 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-cf2937cb-9caa-4d02-986b-403a8e445d13 tempest-GroupSnapshotsV319Test-1250779715 None] group_snapshot 4d33b413-a033-4aa6-9d33-fb65a345c647: deleted successfully Jan 15 21:09:02.701635 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:02.761739 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:09:02.762592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] Volume volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:09:02.772974 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] deleting rbd volume volume-c1dcb2a8-4739-4142-9881-267b03aa7cfd {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:09:03.055503 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] Created reservations ['98297f0e-d454-4088-b809-d5762e214a41'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:03.089426 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1512092601 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1512092601, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:09:03.108510 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] Created reservations ['26b2118e-37aa-4791-9f9a-5d1548f6bc01', '68d9f063-bfe1-47b2-a6f9-38b8b661ec52', '390030e9-05b2-411c-bc6a-6efcc688b5a6', 'ae73073e-5a79-448b-b0bd-2f04cf8ed4e1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:03.235179 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:03.292820 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:03.339715 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:03.344067 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2be25fcb-56f6-404e-9665-d7ed2cea1e55 tempest-GroupSnapshotsV319Test-1250779715 None] Delete group completed successfully. Jan 15 21:09:06.268557 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-65e3242a-0761-4985-8b43-fd369e4f9ce0 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['3095beb9-6c92-4cb9-8e12-5626dc308fd0', 'bef8b9b4-14a9-422f-bcdc-0132786c2593', 'f59784d6-53d9-4ea5-9b42-8aace24f209a', '190cc650-428d-42ee-bfdc-2b4b8d1c69eb'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:06.332249 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-65e3242a-0761-4985-8b43-fd369e4f9ce0 tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:09:06.338181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-65e3242a-0761-4985-8b43-fd369e4f9ce0 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-2f6acdb0-2bad-4dd1-a62e-198080d4683e-delete_snapshot'" released by "delete_snapshot" :: held 30.351s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:07.299181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2bc62eae-d707-4250-9d36-d090405c1353 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-11507cfd-8925-4c71-9440-113a90c7f5bd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:07.303716 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2bc62eae-d707-4250-9d36-d090405c1353 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:09.647317 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:09:09.652631 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:09:09.653275 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:09:09.677617 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Flow 'volume_create_manager' (c4849682-0e3f-4c49-9c55-80707c2ab66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:09:09.686344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4022a3ac-3b0d-4bf5-8137-0e7f4d00fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:09.695747 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:09:09.712962 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4022a3ac-3b0d-4bf5-8137-0e7f4d00fb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1774784445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6eeaabe8-72ef-4001-9b6a-702f988b3c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ee2f32488e438c8ca2a28340a948ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:09:10Z,use_quota=True,user_id='1c19ea8868bc45808f93c4e758f91fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:09.733918 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d2d88e-8855-4b5f-97fd-a99813fb4113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:09.746525 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d2d88e-8855-4b5f-97fd-a99813fb4113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:09.762672 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717f3f71-e728-4a15-9053-cd6e789fec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:09.777517 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717f3f71-e728-4a15-9053-cd6e789fec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eeaabe8-72ef-4001-9b6a-702f988b3c9e', 'volume_name': 'volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:09.787528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f80dd7b-7bd1-48fb-b2ab-93a007cea1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:09.799741 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f80dd7b-7bd1-48fb-b2ab-93a007cea1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:09.811108 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d2a907-7c8f-4d13-b41e-fc9a7ae67c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:09.817276 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Volume 6eeaabe8-72ef-4001-9b6a-702f988b3c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e', 'volume_size': 1} Jan 15 21:09:09.817522 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] creating volume 'volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:09:09.818874 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:09.945372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:09:09.945922 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:09:09.951053 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d2a907-7c8f-4d13-b41e-fc9a7ae67c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:09.956685 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b084715-6fbc-478e-90eb-65dbac2cf357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:09.970602 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Volume volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e (6eeaabe8-72ef-4001-9b6a-702f988b3c9e): created successfully Jan 15 21:09:09.976231 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b084715-6fbc-478e-90eb-65dbac2cf357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:09.983504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Flow 'volume_create_manager' (c4849682-0e3f-4c49-9c55-80707c2ab66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:09:09.993985 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-67d245fe-6e62-41d5-af98-2981ca982722 tempest-VolumesServicesTestJSON-1405888887 None] Created volume successfully. Jan 15 21:09:11.004667 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] Lock "b'cinder-6eeaabe8-72ef-4001-9b6a-702f988b3c9e-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:11.075146 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:11.265777 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:09:11.266200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] Volume volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:09:11.277224 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] deleting rbd volume volume-6eeaabe8-72ef-4001-9b6a-702f988b3c9e {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:09:11.681704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] Created reservations ['d4dbb11e-2ebc-46d8-9e63-77797716f3df', '9f1cfa8f-39f0-4f9d-9a50-8298a3715279', '0e767aeb-5465-4b18-8fa3-6bc609f3d445', '1a1b75f7-01f5-4b04-b4fb-2b0bf002744f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:11.768684 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:11.851650 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:11.934407 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:11.944342 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] Deleted volume successfully. Jan 15 21:09:11.990001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-03ea6904-766d-48f5-84e7-cd7a780c359e tempest-VolumesServicesTestJSON-1405888887 None] Lock "b'cinder-6eeaabe8-72ef-4001-9b6a-702f988b3c9e-delete_volume'" released by "delete_volume" :: held 0.982s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:21.673050 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:09:21.683184 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:09:21.683638 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:09:21.738769 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Flow 'volume_create_manager' (3aac2bf0-8a42-4056-b528-c3b929a4f248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:09:21.758863 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8454d011-2aa0-4780-9be8-db241a3712d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:21.773459 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:09:21.818463 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8454d011-2aa0-4780-9be8-db241a3712d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1201917587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a3b6da4-2b71-4869-96dd-08d3dcc250a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1927db1fdc428db486a728f66309c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:09:22Z,use_quota=True,user_id='7451b9da31e34e93a56b71259e2dee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(334fac9a-99c4-4786-b1c2-4f711a52cc61),volume_type_id=334fac9a-99c4-4786-b1c2-4f711a52cc61)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:21.825499 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13f9852-4384-4385-b7f5-dce12876ffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:21.831623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13f9852-4384-4385-b7f5-dce12876ffdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:21.837595 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a278a747-19ab-440e-a16c-812a60936fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:21.843531 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a278a747-19ab-440e-a16c-812a60936fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3b6da4-2b71-4869-96dd-08d3dcc250a7', 'volume_name': 'volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:21.856618 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb90c86b-4c5b-4b57-a466-d94aac81219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:21.874728 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb90c86b-4c5b-4b57-a466-d94aac81219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:21.881913 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02524cbc-ef6e-4c4d-80c4-799f0da921da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:21.883476 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Volume 7a3b6da4-2b71-4869-96dd-08d3dcc250a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7', 'volume_size': 1} Jan 15 21:09:21.884613 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] creating volume 'volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:09:21.887914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:22.019334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:09:22.019559 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:09:22.029148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02524cbc-ef6e-4c4d-80c4-799f0da921da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:22.042285 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28a84f-9ec8-4f98-a44d-124407a664c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:22.062335 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Volume volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7 (7a3b6da4-2b71-4869-96dd-08d3dcc250a7): created successfully Jan 15 21:09:22.074898 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a28a84f-9ec8-4f98-a44d-124407a664c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:22.081851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Flow 'volume_create_manager' (3aac2bf0-8a42-4056-b528-c3b929a4f248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:09:22.095176 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-930897db-18bc-4499-a399-ba0f7147239c tempest-VolumeTypesTest-403936294 None] Created volume successfully. Jan 15 21:09:23.270625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4d7f4613-91a2-42ab-9980-8d6f50f2511f tempest-VolumeTypesTest-403936294 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:23.336413 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4d7f4613-91a2-42ab-9980-8d6f50f2511f tempest-VolumeTypesTest-403936294 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:23.414171 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-4d7f4613-91a2-42ab-9980-8d6f50f2511f tempest-VolumeTypesTest-403936294 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:23.419122 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4d7f4613-91a2-42ab-9980-8d6f50f2511f tempest-VolumeTypesTest-403936294 None] Retype volume completed successfully. Jan 15 21:09:23.791839 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3310904e-9213-441e-b2e7-34cba5de9c3f req-61fab00b-4003-42ce-8e82-454e113ae756 tempest-TaggedBootDevicesTest-1219595898 None] Terminate volume connection completed successfully. Jan 15 21:09:23.792822 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3310904e-9213-441e-b2e7-34cba5de9c3f req-61fab00b-4003-42ce-8e82-454e113ae756 tempest-TaggedBootDevicesTest-1219595898 None] Deleting attachment efca1b69-5f66-490c-87a5-f6b2238dc71d. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:09:23.998454 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3310904e-9213-441e-b2e7-34cba5de9c3f req-8cefde3f-4338-4a87-9f10-19e36f731eb4 tempest-TaggedBootDevicesTest-1219595898 None] Terminate volume connection completed successfully. Jan 15 21:09:23.999083 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3310904e-9213-441e-b2e7-34cba5de9c3f req-8cefde3f-4338-4a87-9f10-19e36f731eb4 tempest-TaggedBootDevicesTest-1219595898 None] Deleting attachment b5a088a9-1ead-4a61-ade1-4eae1622e8d8. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:09:24.172817 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-3310904e-9213-441e-b2e7-34cba5de9c3f req-a18fb03f-91df-4418-9daa-3dfd3bbd10d1 tempest-TaggedBootDevicesTest-1219595898 None] Terminate volume connection completed successfully. Jan 15 21:09:24.173376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-3310904e-9213-441e-b2e7-34cba5de9c3f req-a18fb03f-91df-4418-9daa-3dfd3bbd10d1 tempest-TaggedBootDevicesTest-1219595898 None] Deleting attachment dc405875-4cf5-4127-aa8f-5b64ba076213. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:09:25.784324 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Lock "b'cinder-7a3b6da4-2b71-4869-96dd-08d3dcc250a7-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:25.858054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:25.970071 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:09:25.970899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Volume volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:09:25.986731 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] deleting rbd volume volume-7a3b6da4-2b71-4869-96dd-08d3dcc250a7 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:09:26.290964 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-70224194 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-70224194, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:09:26.292025 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-70224194 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-70224194, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:09:26.325220 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Created reservations ['e44fa187-6220-4c44-ab32-6c46446995b3', 'b8693b5d-3cf8-4725-ab4a-f2516c38382d', '91a6d50f-72bd-4bdd-8612-9cd80f0a20dd', 'cf8ca8bd-2eb2-4b25-83e9-725f1794cc46'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:26.412727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:26.473086 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:26.528731 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:26.543909 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Deleted volume successfully. Jan 15 21:09:26.561487 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-09638fe8-b368-4aa5-b224-e9fb24a2c790 tempest-VolumeTypesTest-403936294 None] Lock "b'cinder-7a3b6da4-2b71-4869-96dd-08d3dcc250a7-delete_volume'" released by "delete_volume" :: held 0.780s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:31.726141 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-9df52e98-8cdf-4ad5-b0c1-c486b68fb042-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:31.801114 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:31.905576 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:09:31.907555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] Volume volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:09:31.919609 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] deleting rbd volume volume-9df52e98-8cdf-4ad5-b0c1-c486b68fb042 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:09:32.339441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] Created reservations ['4a7fe951-e451-4fbb-92f8-4c5a3d7f7169', '1c9fc1da-1fb9-4d07-a489-efa846d2d006', 'd25b0b70-9fe6-45c6-aace-23d83448005d', '0b4f4010-1a1d-4c4c-a693-395ea2c0f74a'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:32.412732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:32.467366 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:32.527158 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:32.533281 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] Deleted volume successfully. Jan 15 21:09:32.548551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e802728c-f1ce-490d-9167-b09772c92ebc tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-9df52e98-8cdf-4ad5-b0c1-c486b68fb042-delete_volume'" released by "delete_volume" :: held 0.823s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:32.973534 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-aa8e576c-d6ef-43bc-bde0-1914820f85a1-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:33.037859 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:33.102622 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:09:33.103048 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] Volume volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:09:33.108977 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] deleting rbd volume volume-aa8e576c-d6ef-43bc-bde0-1914820f85a1 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:09:33.407706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] Created reservations ['4fb81747-279d-4d9f-a264-2bd7843c52cf', '35f54022-042a-4030-8cee-bb4e95ef39a5', '54d71a79-a925-45b9-b5c4-131d2baa24f6', '80a7b7af-743f-4b52-ba67-7369e1823dcd'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:33.510781 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:33.582456 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:33.640381 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:33.653381 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] Deleted volume successfully. Jan 15 21:09:33.693094 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-cacae791-3f37-472c-8974-7f372a283af7 tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-aa8e576c-d6ef-43bc-bde0-1914820f85a1-delete_volume'" released by "delete_volume" :: held 0.720s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:34.783486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-0914c9c7-c7ec-4509-8149-015f4d73dd20-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:34.850242 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:34.953420 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:09:34.965288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] deleting rbd volume volume-0914c9c7-c7ec-4509-8149-015f4d73dd20 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:09:35.289969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:09:35.326164 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] deleting parent snapshot volume-0914c9c7-c7ec-4509-8149-015f4d73dd20.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:09:36.384939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] Created reservations ['ab57b90c-cbc8-45ef-8d2e-bb529766a3ac', '5a8c7eb7-5617-49ab-a9ab-ee0cc798ce0e', '8518dad8-a264-428a-9ec4-96daab522d17', '6d2cc8a1-1561-4f6c-9c54-cf8e979f3270'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:36.487740 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:36.606158 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:36.700888 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:36.711756 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] Deleted volume successfully. Jan 15 21:09:36.731390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d0968a82-2da6-4cc2-93d7-846684cc2425 tempest-TaggedBootDevicesTest-1219595898 None] Lock "b'cinder-0914c9c7-c7ec-4509-8149-015f4d73dd20-delete_volume'" released by "delete_volume" :: held 1.945s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:37.547455 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2bc62eae-d707-4250-9d36-d090405c1353 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['f9aedbaf-39c5-44ae-86e3-f75a8689d1fb', '9ad2a93b-7403-416b-96a7-1c1887e14552', '450f5753-dc54-4d82-b5b1-f56fb72d1896', '36c6fb3b-efdb-47de-bc07-3e4674f138c6'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:09:37.624094 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2bc62eae-d707-4250-9d36-d090405c1353 tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:09:37.631472 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2bc62eae-d707-4250-9d36-d090405c1353 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-11507cfd-8925-4c71-9440-113a90c7f5bd-delete_snapshot'" released by "delete_snapshot" :: held 30.332s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:09:37.884564 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1b430345-fa09-472d-930b-3f997b7fa7a5 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-a3be212d-96b5-41b0-8a75-17452d7126d2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:09:37.887664 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1b430345-fa09-472d-930b-3f997b7fa7a5 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:41.306531 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:09:41.307785 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:41.380829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:41.439148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:09:43.573705 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:09:43.582387 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:09:43.583750 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:09:43.619954 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Flow 'volume_create_manager' (3696b1e5-7c04-4e0d-a37d-4f166be3a70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:09:43.628677 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb0c866-5e09-410d-80c4-bf5846134103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:43.643719 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:09:43.671701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb0c866-5e09-410d-80c4-bf5846134103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1736290540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c8dd6789ba45a7a04452dc080a37cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:09:44Z,use_quota=True,user_id='a8117ed926ac40dbbdcbca53cd668c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:43.684404 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142762ad-c60f-4f92-a303-5129d72470bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:43.691277 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142762ad-c60f-4f92-a303-5129d72470bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:43.698727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e858a6c4-f12d-4080-a52a-a69407ca869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:43.707711 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e858a6c4-f12d-4080-a52a-a69407ca869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac', 'volume_name': 'volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:43.713744 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd39b43-9e83-43db-adc9-ee0f1695a38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:43.719047 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd39b43-9e83-43db-adc9-ee0f1695a38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:43.728564 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed2e10-0fc9-4b7e-987e-948af0341a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:43.730346 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Volume ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac', 'volume_size': 1} Jan 15 21:09:43.731018 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] creating volume 'volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:09:43.732731 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:09:43.863434 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:09:43.863866 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:09:43.869164 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed2e10-0fc9-4b7e-987e-948af0341a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:43.877090 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4898651a-6294-45a5-9941-c5e3edcd8741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:09:43.893060 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Volume volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac (ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac): created successfully Jan 15 21:09:43.918549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4898651a-6294-45a5-9941-c5e3edcd8741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:09:43.940217 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Flow 'volume_create_manager' (3696b1e5-7c04-4e0d-a37d-4f166be3a70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:09:43.982225 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8002471e-d1e5-4487-8303-58994ffd71c0 tempest-VolumesActionsTest-777683023 None] Created volume successfully. Jan 15 21:10:01.440180 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-6ce1bdb6-7657-4546-bdc6-df00d2978986 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac'" acquired by "attach_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:01.515544 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6ce1bdb6-7657-4546-bdc6-df00d2978986 tempest-VolumesActionsTest-777683023 None] Attaching volume ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac to instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1 at mountpoint /dev/sdb on host None. Jan 15 21:10:01.566086 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6ce1bdb6-7657-4546-bdc6-df00d2978986 tempest-VolumesActionsTest-777683023 None] Attach volume completed successfully. Jan 15 21:10:01.574392 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-6ce1bdb6-7657-4546-bdc6-df00d2978986 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac'" released by "attach_volume" :: held 0.134s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:01.773134 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8c4d86cb-71ae-495d-936d-9bdb0e7f02fd tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:01.773716 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8c4d86cb-71ae-495d-936d-9bdb0e7f02fd tempest-VolumesActionsTest-777683023 None] Detaching volume ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac from instance a908b8d0-88c5-44e7-920a-1d9f54de7cb1. Jan 15 21:10:01.837533 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8c4d86cb-71ae-495d-936d-9bdb0e7f02fd tempest-VolumesActionsTest-777683023 None] Detach volume completed successfully. Jan 15 21:10:01.843300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8c4d86cb-71ae-495d-936d-9bdb0e7f02fd tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-detach_volume'" released by "detach_volume" :: held 0.071s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:08.191813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1b430345-fa09-472d-930b-3f997b7fa7a5 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['87a4332c-8dcb-4153-b529-77a46e2a245c', '62031d63-a7ed-4161-94f8-1707a5d355eb', '055f31ef-e111-4f82-ada0-b56555b9f2e9', '89d23002-1695-4d6d-8119-b0df17a56739'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:08.238209 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1b430345-fa09-472d-930b-3f997b7fa7a5 tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:10:08.243423 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1b430345-fa09-472d-930b-3f997b7fa7a5 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-a3be212d-96b5-41b0-8a75-17452d7126d2-delete_snapshot'" released by "delete_snapshot" :: held 30.359s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:10.207996 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-553e5d1c-1ad1-4357-8185-599ef0fb4030 req-3e8bdd7c-6066-4e1c-9bf1-e96cfe6d0481 tempest-VolumesSnapshotTestJSON-711254379 None] Terminate volume connection completed successfully. Jan 15 21:10:10.208572 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-553e5d1c-1ad1-4357-8185-599ef0fb4030 req-3e8bdd7c-6066-4e1c-9bf1-e96cfe6d0481 tempest-VolumesSnapshotTestJSON-711254379 None] Deleting attachment 68aaba95-3172-442a-8a34-e95ccfffc0d6. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:10:16.191885 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9e4a6470-0014-46c7-a05f-c5560d5a6c3c tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:17.385193 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9e4a6470-0014-46c7-a05f-c5560d5a6c3c tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:10:18.570913 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ca6625a1-8efb-4d5c-bf05-bfd1dd689e35 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-d680caa3-aaf6-4222-89f7-10e9d25c820d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:18.574799 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ca6625a1-8efb-4d5c-bf05-bfd1dd689e35 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:19.398866 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ca6625a1-8efb-4d5c-bf05-bfd1dd689e35 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['52dd12c0-e2e2-4527-b156-e39210b2322c', '02f8c06c-b07f-4386-8509-d997b91f757f', 'a7e1b633-e58c-4a47-beb2-99f94ed42fb6', '06ebbf86-da2b-4310-a0be-56309f1ced1d'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:19.447760 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ca6625a1-8efb-4d5c-bf05-bfd1dd689e35 tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:10:19.458870 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ca6625a1-8efb-4d5c-bf05-bfd1dd689e35 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-d680caa3-aaf6-4222-89f7-10e9d25c820d-delete_snapshot'" released by "delete_snapshot" :: held 0.888s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:19.971016 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c030c6e3-444d-4d5c-9d80-74ea75f3dfee tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:21.140745 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c030c6e3-444d-4d5c-9d80-74ea75f3dfee tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:10:21.741532 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-47e11529-64b2-4ba4-886a-3bea7f139a04 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac'" acquired by "attach_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:21.796783 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-47e11529-64b2-4ba4-886a-3bea7f139a04 tempest-VolumesActionsTest-777683023 None] Attaching volume ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac to instance c150ed13-89c9-4f8a-b20b-819effbc3bcc at mountpoint /dev/sdb on host None. Jan 15 21:10:21.823888 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-47e11529-64b2-4ba4-886a-3bea7f139a04 tempest-VolumesActionsTest-777683023 None] Attach volume completed successfully. Jan 15 21:10:21.828551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-47e11529-64b2-4ba4-886a-3bea7f139a04 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac'" released by "attach_volume" :: held 0.087s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:22.057125 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1f1a2426-7035-4380-8e9e-b9e6679ec775 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:22.057780 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1f1a2426-7035-4380-8e9e-b9e6679ec775 tempest-VolumesActionsTest-777683023 None] Detaching volume ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac from instance c150ed13-89c9-4f8a-b20b-819effbc3bcc. Jan 15 21:10:22.102567 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1f1a2426-7035-4380-8e9e-b9e6679ec775 tempest-VolumesActionsTest-777683023 None] Detach volume completed successfully. Jan 15 21:10:22.109910 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1f1a2426-7035-4380-8e9e-b9e6679ec775 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-detach_volume'" released by "detach_volume" :: held 0.053s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:23.938673 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:10:23.944443 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:10:23.945205 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:10:23.972707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Flow 'volume_create_manager' (378586db-e895-4b78-9234-79f7b318e0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:23.980349 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a98690b-b8df-4872-b3c8-57f85ccb573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:23.987632 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:10:24.015582 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a98690b-b8df-4872-b3c8-57f85ccb573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1115033608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f32bdad0-4fee-418e-9bac-9ef9f35f18bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610bf9da3e4d40c6b6228c2b3b0b2f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:10:24Z,use_quota=True,user_id='60088274ec1d45b0ae8e827257b2d460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:24.022167 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe0f477-efb1-4a14-b686-b2ccadf21209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:24.027558 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe0f477-efb1-4a14-b686-b2ccadf21209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:24.034554 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cea820-3bb3-4c05-817c-7391d105e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:24.042627 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cea820-3bb3-4c05-817c-7391d105e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32bdad0-4fee-418e-9bac-9ef9f35f18bb', 'volume_name': 'volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:24.065423 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15308a01-0cd7-4c17-b455-f1733b15a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:24.073606 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15308a01-0cd7-4c17-b455-f1733b15a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:24.087673 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef573dd4-e653-4038-bd7d-21f2bb402dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:24.088782 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Volume f32bdad0-4fee-418e-9bac-9ef9f35f18bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb', 'volume_size': 1} Jan 15 21:10:24.089948 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] creating volume 'volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:10:24.092877 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:24.206676 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:10:24.207644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:10:24.212986 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef573dd4-e653-4038-bd7d-21f2bb402dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:24.219392 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b704506-b21e-4d2b-9cd5-47672ca020c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:24.240791 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Volume volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb (f32bdad0-4fee-418e-9bac-9ef9f35f18bb): created successfully Jan 15 21:10:24.245654 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b704506-b21e-4d2b-9cd5-47672ca020c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:24.253428 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Flow 'volume_create_manager' (378586db-e895-4b78-9234-79f7b318e0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:24.276337 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-59263684-2c7f-4682-bc00-72be4fdd1338 tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Created volume successfully. Jan 15 21:10:25.199399 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c5a697a2-6677-4ca1-b19f-e0e470b81d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:26.366985 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c5a697a2-6677-4ca1-b19f-e0e470b81d6a tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Create snapshot completed successfully Jan 15 21:10:26.790090 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-e48dfd0f-fb81-473e-ab8e-a0f9098e7a0c tempest-VolumesActionsTest-777683023 None] Running cmd (subprocess): rbd export --pool volumes volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac /opt/stack/data/cinder/conversion/volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-2d953b87-ceaa-47ae-8084-3259fb84f6e0 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:10:27.916435 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-e48dfd0f-fb81-473e-ab8e-a0f9098e7a0c tempest-VolumesActionsTest-777683023 None] CMD "rbd export --pool volumes volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac /opt/stack/data/cinder/conversion/volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-2d953b87-ceaa-47ae-8084-3259fb84f6e0 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.125s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:10:27.931758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.image_utils [None req-e48dfd0f-fb81-473e-ab8e-a0f9098e7a0c tempest-VolumesActionsTest-777683023 None] 2d953b87-ceaa-47ae-8084-3259fb84f6e0 was raw, no need to convert to raw {{(pid=122725) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Jan 15 21:10:28.049495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a87cc440-a963-4515-ac45-26f0949a3c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Lock "b'cinder-245810ba-57da-4fd5-8095-f9ace8d27832-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:28.052025 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a87cc440-a963-4515-ac45-26f0949a3c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:28.495233 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a87cc440-a963-4515-ac45-26f0949a3c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Created reservations ['1b18579e-2edb-491b-99bc-03677d6096c9', '07921053-e5c8-4dcc-b77c-1ab275538df7', '3eef4485-433b-4342-80e5-b6739b7cdb87', '3088e637-2d54-419d-8099-9c87dcdd1d3a'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:28.597502 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a87cc440-a963-4515-ac45-26f0949a3c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Delete snapshot completed successfully. Jan 15 21:10:28.604090 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a87cc440-a963-4515-ac45-26f0949a3c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Lock "b'cinder-245810ba-57da-4fd5-8095-f9ace8d27832-delete_snapshot'" released by "delete_snapshot" :: held 0.555s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:29.331380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Lock "b'cinder-f32bdad0-4fee-418e-9bac-9ef9f35f18bb-delete_volume'" acquired by "delete_volume" :: waited 0.057s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:29.443124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:29.533871 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:10:29.534239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Volume volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:10:29.546093 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] deleting rbd volume volume-f32bdad0-4fee-418e-9bac-9ef9f35f18bb {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:10:29.991347 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Created reservations ['c806d240-502e-430f-8005-525a505948e6', 'ae8591ee-cd5f-4d52-838c-8f5512b6684a', '8d1dc7d5-a92c-4f39-b42f-3ea95372b931', 'aed72476-d4f1-4546-b26b-ebc0863e9021'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:30.108364 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:30.191556 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:30.271365 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:10:30.278150 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Deleted volume successfully. Jan 15 21:10:30.309856 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4fc14d96-253a-4db1-887e-eb4c6ae6263d tempest-VolumeSnapshotQuotasNegativeTestJSON-574735351 None] Lock "b'cinder-f32bdad0-4fee-418e-9bac-9ef9f35f18bb-delete_volume'" released by "delete_volume" :: held 0.978s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:38.446873 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf req-e7ad5e0b-a49c-4018-b8e1-aaf2c8897c01 tempest-VolumesSnapshotTestJSON-711254379 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:10:40.418290 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fe4f539d-0dac-4118-b204-e9ca6470c3b9 tempest-BackendsCapabilitiesAdminTestsJSON-1011926630 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:667354f5-12ed-4ec2-a0f3-78cc2b3addc4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=122725) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Jan 15 21:10:40.507139 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12674ae9-01df-4b43-b29e-2c185a5dad2f tempest-BackendsCapabilitiesAdminTestsJSON-1011926630 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:667354f5-12ed-4ec2-a0f3-78cc2b3addc4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=122725) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} Jan 15 21:10:40.550204 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf req-e7ad5e0b-a49c-4018-b8e1-aaf2c8897c01 tempest-VolumesSnapshotTestJSON-711254379 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.103s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:10:40.559367 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf req-e7ad5e0b-a49c-4018-b8e1-aaf2c8897c01 tempest-VolumesSnapshotTestJSON-711254379 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-54e36e7f-6e75-428b-97f3-c673d414e0e9', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '54e36e7f-6e75-428b-97f3-c673d414e0e9', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:10:40.635811 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf req-e7ad5e0b-a49c-4018-b8e1-aaf2c8897c01 tempest-VolumesSnapshotTestJSON-711254379 None] Connection info returned from driver {'name': 'volumes/volume-54e36e7f-6e75-428b-97f3-c673d414e0e9', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '54e36e7f-6e75-428b-97f3-c673d414e0e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5f29796d-d578-4aac-8093-f2c68ba18906'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:10:40.746692 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-cb8dcd5d-2987-4eae-a6c4-690dfbb529cf req-e7ad5e0b-a49c-4018-b8e1-aaf2c8897c01 tempest-VolumesSnapshotTestJSON-711254379 None] attachment_update completed successfully. Jan 15 21:10:41.304854 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:10:41.311542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:41.408733 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:41.460933 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:10:43.507362 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-64ffcb2f-121a-436c-9a9a-0adbcf237bff tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:44.329236 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-64ffcb2f-121a-436c-9a9a-0adbcf237bff tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:10:45.085223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e44db03e-1ccf-4535-91ed-6c88afc0fb1e tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:46.410708 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e44db03e-1ccf-4535-91ed-6c88afc0fb1e tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:10:47.209255 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-92e0f4fe-fdac-4a90-a811-870d5243b82d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-685511a0-015c-44e6-b7e7-1238bf85c209-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.043s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:47.217027 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92e0f4fe-fdac-4a90-a811-870d5243b82d tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:50.257763 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:10:50.267829 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:10:50.268517 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:10:50.324506 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (315f3fc4-01ad-434e-8848-7f16e6d80fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:50.344740 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26d4b8a-5fb0-4ec9-a6c3-691f688a5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:50.362414 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:10:50.400457 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26d4b8a-5fb0-4ec9-a6c3-691f688a5d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1147362101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ddc7c43-e962-4a97-86f9-df25d5a282f2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:10:50Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:50.417534 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349e84f4-ff7c-48f6-9636-a097aa0bf470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:50.431801 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349e84f4-ff7c-48f6-9636-a097aa0bf470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:50.445644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1df1d5-2ac5-47f6-a05e-8d9d0e62adca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:50.462300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1df1d5-2ac5-47f6-a05e-8d9d0e62adca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ddc7c43-e962-4a97-86f9-df25d5a282f2', 'volume_name': 'volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:50.482761 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729daf0a-e5f0-4466-9811-4fc992c73580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:50.492203 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729daf0a-e5f0-4466-9811-4fc992c73580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:50.499481 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2966f25-0e98-4658-a4ed-d6a1690d353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:50.501543 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Volume 1ddc7c43-e962-4a97-86f9-df25d5a282f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2', 'volume_size': 1} Jan 15 21:10:50.503541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] creating volume 'volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:10:50.505518 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:50.688905 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:10:50.689350 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:10:50.694692 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2966f25-0e98-4658-a4ed-d6a1690d353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:50.711163 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54796fed-75f2-4389-9530-b52aca786cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:50.730772 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Volume volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2 (1ddc7c43-e962-4a97-86f9-df25d5a282f2): created successfully Jan 15 21:10:50.738040 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54796fed-75f2-4389-9530-b52aca786cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:50.774473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (315f3fc4-01ad-434e-8848-7f16e6d80fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:50.813926 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-49e74641-bd8d-47d4-9ef6-b064b561e5ba tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:10:50.991854 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:10:51.014445 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:10:51.015076 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:10:51.042808 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Flow 'volume_create_manager' (8bfc6a68-ff66-4b2c-8663-6cfb68b995c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:51.067292 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85714aa7-16f1-48d9-8bef-21e82c45d345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:51.086728 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:10:51.115113 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85714aa7-16f1-48d9-8bef-21e82c45d345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-830737693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=538ca307-2fb7-4074-bfb1-c6e434f6288a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219ab37be9d24715a94f7e95c5a7e0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:10:51Z,use_quota=True,user_id='c58b128f667248219b00ef98a236ed42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad247f5c-9ab1-4a97-b3da-6b8b3dc6e21d),volume_type_id=ad247f5c-9ab1-4a97-b3da-6b8b3dc6e21d)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:51.156973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7706285a-3d5c-4bc8-aad0-27fb8e1ea2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:51.168204 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7706285a-3d5c-4bc8-aad0-27fb8e1ea2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:51.188088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e4dda0-4885-4c3e-9764-471d708f921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:51.209728 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e4dda0-4885-4c3e-9764-471d708f921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538ca307-2fb7-4074-bfb1-c6e434f6288a', 'volume_name': 'volume-538ca307-2fb7-4074-bfb1-c6e434f6288a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:51.217441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d2e9ca-8b1d-4f5c-9b60-53d7efa2e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:51.221879 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d2e9ca-8b1d-4f5c-9b60-53d7efa2e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:51.232928 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f9bc46-1574-40f5-a445-122acbdcc218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:51.246160 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Volume 538ca307-2fb7-4074-bfb1-c6e434f6288a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538ca307-2fb7-4074-bfb1-c6e434f6288a', 'volume_size': 1} Jan 15 21:10:51.247692 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] creating volume 'volume-538ca307-2fb7-4074-bfb1-c6e434f6288a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:10:51.251130 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:51.458486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:10:51.459176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:10:51.469568 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f9bc46-1574-40f5-a445-122acbdcc218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538ca307-2fb7-4074-bfb1-c6e434f6288a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:51.476036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc561e31-fcb5-4fd4-b419-1b4a0cdbf316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:51.503516 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Volume volume-538ca307-2fb7-4074-bfb1-c6e434f6288a (538ca307-2fb7-4074-bfb1-c6e434f6288a): created successfully Jan 15 21:10:51.503516 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc561e31-fcb5-4fd4-b419-1b4a0cdbf316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:51.514213 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Flow 'volume_create_manager' (8bfc6a68-ff66-4b2c-8663-6cfb68b995c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:51.534455 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a7e304dd-a5d1-4d65-9a7c-79f41c974d33 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Created volume successfully. Jan 15 21:10:52.407690 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:10:52.420817 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:10:52.423852 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:10:52.488000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (1540491e-e9c0-401d-9e64-6abe210acf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:52.517402 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ef9afa-dc1a-4e2b-9e23-24bd8ca72e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:52.530425 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:10:52.557129 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ef9afa-dc1a-4e2b-9e23-24bd8ca72e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:10:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291242522',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ce62c12-cd01-44be-9b5e-0078a70acfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:10:52Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:52.565582 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afde8c8e-f866-4da4-b143-2f5eb8ac9f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:52.571944 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afde8c8e-f866-4da4-b143-2f5eb8ac9f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:52.580395 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107392cf-da78-4918-9d48-2e86485c45a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:52.586234 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107392cf-da78-4918-9d48-2e86485c45a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce62c12-cd01-44be-9b5e-0078a70acfcc', 'volume_name': 'volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:52.604505 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf57348f-a00b-4978-b7c5-5ccca33bc736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:52.612872 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf57348f-a00b-4978-b7c5-5ccca33bc736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:52.619664 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312f1ecc-86fc-43d8-ad85-a82f4b31f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:52.621544 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Volume 9ce62c12-cd01-44be-9b5e-0078a70acfcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc', 'volume_size': 1} Jan 15 21:10:52.622659 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] creating volume 'volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:10:52.623843 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:52.807736 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:10:52.808380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:10:52.817577 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312f1ecc-86fc-43d8-ad85-a82f4b31f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:52.832618 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8891860f-2b7f-49d1-98d1-c6184b857498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:52.896989 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Volume volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc (9ce62c12-cd01-44be-9b5e-0078a70acfcc): created successfully Jan 15 21:10:52.910018 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8891860f-2b7f-49d1-98d1-c6184b857498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:52.918167 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (1540491e-e9c0-401d-9e64-6abe210acf27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:52.947401 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-661de2ee-5ce9-45e2-a567-c8c7fab82cff tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:10:53.033472 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-509a64ed-10e6-4a5e-8f58-22ba34cc93c6 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:53.113659 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-509a64ed-10e6-4a5e-8f58-22ba34cc93c6 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:53.171286 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-509a64ed-10e6-4a5e-8f58-22ba34cc93c6 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:10:53.176863 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-509a64ed-10e6-4a5e-8f58-22ba34cc93c6 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Retype volume completed successfully. Jan 15 21:10:53.649268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-9ce62c12-cd01-44be-9b5e-0078a70acfcc-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:53.718925 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:53.815601 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:10:53.816042 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] Volume volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:10:53.827486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-9ce62c12-cd01-44be-9b5e-0078a70acfcc {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:10:54.212634 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Lock "b'cinder-538ca307-2fb7-4074-bfb1-c6e434f6288a-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:54.330260 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:54.470268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:10:54.471054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Volume volume-538ca307-2fb7-4074-bfb1-c6e434f6288a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:10:54.484259 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] deleting rbd volume volume-538ca307-2fb7-4074-bfb1-c6e434f6288a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:10:54.559771 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] Created reservations ['caf99c6e-c8eb-4526-b7c6-c3f6f833d18f', '0781db38-25c2-4ff3-9bd4-b9dd39f9d10a', '3074b822-cf15-4e76-8776-f7d96fa0384a', '88e1a151-9c75-493b-9aee-98e650dd93fe'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:54.638742 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:54.701804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:54.785307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:10:54.792219 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:10:54.845772 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-5188c06b-6ce9-4b31-97de-b84c4e56a9a3 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-9ce62c12-cd01-44be-9b5e-0078a70acfcc-delete_volume'" released by "delete_volume" :: held 1.193s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:54.850209 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] Lock "b'cinder-1ddc7c43-e962-4a97-86f9-df25d5a282f2-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:10:54.884461 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:10:54.884461 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:10:54.918009 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:54.966602 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:10:54.967087 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] Volume volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:10:54.973963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-1ddc7c43-e962-4a97-86f9-df25d5a282f2 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:10:54.976442 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Created reservations ['d5400dc0-3176-487c-a9d7-671c66e7acc4', '8f4fbbfb-974b-4696-8396-316e148bf851', 'a8b0e404-6804-4875-a714-3201334a209c', '13bcf118-1f25-4e23-9388-b4a2acbaeec2'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:55.045013 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:55.092662 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:55.145430 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:10:55.151511 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Deleted volume successfully. Jan 15 21:10:55.174422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-92b840b5-a908-46f5-8f96-b60e9fb21474 tempest-VolumeRetypeWithoutMigrationTest-312767666 None] Lock "b'cinder-538ca307-2fb7-4074-bfb1-c6e434f6288a-delete_volume'" released by "delete_volume" :: held 0.962s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:55.360779 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] Created reservations ['bc310064-171e-49c2-a5ef-8fb1813ba2c5', '0905bb3b-4d3e-4ae8-8945-c1a7adaea1df', 'da389cf8-bee8-49bc-b1fd-9f54f05177e4', 'c63eba99-25ff-4edf-8b55-82854a9f4dfe'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:10:55.504381 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:55.602441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:55.657974 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:10:55.664834 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:10:55.693636 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-36ce7c78-de21-4446-9a7e-2fa150b39f9a tempest-VolumesGetTest-192442191 None] Lock "b'cinder-1ddc7c43-e962-4a97-86f9-df25d5a282f2-delete_volume'" released by "delete_volume" :: held 0.843s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:10:56.657111 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:10:56.663886 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:10:56.664348 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:10:56.717380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (09629af2-8789-4882-8e20-870273c186da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:56.724194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137a9d07-d60b-46d4-81ad-38fa8f13859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:56.748788 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:10:56.772757 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137a9d07-d60b-46d4-81ad-38fa8f13859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1254045637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e15a700-bcc2-4a69-ab7e-e3afae34db53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:10:57Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:56.793030 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dc61c3-6ea6-4c3a-a178-c9fa9578434c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:56.800832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dc61c3-6ea6-4c3a-a178-c9fa9578434c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:56.819837 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6488fbbb-c5b5-47d8-9124-5cd26bc24623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:56.824278 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6488fbbb-c5b5-47d8-9124-5cd26bc24623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'volume_name': 'volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:56.842386 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecce863b-b301-4713-a716-a8c911da1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:56.846412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecce863b-b301-4713-a716-a8c911da1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:56.859022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1f03a4-0f3e-4b87-be26-9097711b0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:56.860298 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Volume 6e15a700-bcc2-4a69-ab7e-e3afae34db53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'volume_size': 1} Jan 15 21:10:56.860723 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] creating volume 'volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:10:56.861776 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:57.020232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:10:57.020621 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:10:57.029589 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1f03a4-0f3e-4b87-be26-9097711b0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:57.037244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b764b7cc-85ad-4ce4-a5bd-398dc6d6700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:57.054252 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Volume volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53 (6e15a700-bcc2-4a69-ab7e-e3afae34db53): created successfully Jan 15 21:10:57.060486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b764b7cc-85ad-4ce4-a5bd-398dc6d6700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:57.093288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (09629af2-8789-4882-8e20-870273c186da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:57.130980 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-50405cd2-5a8c-4bb8-be34-aeefb3067c77 tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:10:58.448157 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:10:58.453168 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:10:58.454111 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:10:58.491875 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (a08246dc-63df-40ba-8b42-b4eb53cf0771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:58.499248 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed5c08c-3764-452c-8da3-0ff4772d4a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:58.508019 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:10:58.526274 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed5c08c-3764-452c-8da3-0ff4772d4a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-782079267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=100b5402-65e2-48fe-a8a3-d3e83c15ea06,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6e15a700-bcc2-4a69-ab7e-e3afae34db53,status='creating',terminated_at=None,updated_at=2022-01-15T21:10:58Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:58.534244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bc471e-8df6-4aac-9009-a94905cc1047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:58.541036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bc471e-8df6-4aac-9009-a94905cc1047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:58.548464 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c615a192-da13-40c7-8e17-b4358be9e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:58.573506 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c615a192-da13-40c7-8e17-b4358be9e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '100b5402-65e2-48fe-a8a3-d3e83c15ea06', 'volume_name': 'volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06', 'volume_size': 1, 'source_volid': '6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'source_volstatus': 'available'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:58.579023 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0106df-570f-431d-819f-5e7185847b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:58.583175 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0106df-570f-431d-819f-5e7185847b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:58.587965 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (face2e43-8cec-4e93-9679-6e9190bcb4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:58.591731 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Volume 100b5402-65e2-48fe-a8a3-d3e83c15ea06: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06', 'volume_size': 1, 'source_volid': '6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'source_volstatus': 'available'} Jan 15 21:10:58.611012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:10:58.677057 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] creating snapshot='volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:10:58.813092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] cloning 'volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53@volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06.clone_snap' to 'volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:10:58.965671 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Volume volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:10:58.966778 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:10:58.967147 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:10:58.999119 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:10:59.004800 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (face2e43-8cec-4e93-9679-6e9190bcb4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06', 'volume_size': 1, 'source_volid': '6e15a700-bcc2-4a69-ab7e-e3afae34db53', 'source_volstatus': 'available'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:59.015470 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d6bc48-0e2c-4a6e-b3f8-eb82ea750c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:10:59.042540 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Volume volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06 (100b5402-65e2-48fe-a8a3-d3e83c15ea06): created successfully Jan 15 21:10:59.060569 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d6bc48-0e2c-4a6e-b3f8-eb82ea750c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:10:59.071144 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (a08246dc-63df-40ba-8b42-b4eb53cf0771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:10:59.101548 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-36dcdc70-bb59-4b14-937f-c805048c3e75 tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:11:00.470966 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:00.477765 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:00.478398 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:00.513177 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (a68caef4-aa2f-4964-8b01-b00ea3a848c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:00.520358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dfd564-d13c-4b6d-a391-ab5c7b08ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:00.527571 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:00.549188 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dfd564-d13c-4b6d-a391-ab5c7b08ac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-219007856',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=446d9882-50fd-4374-ae69-61859481dd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:00Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:00.554024 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d389ee-7941-4319-964e-079f2ee3b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:00.558293 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d389ee-7941-4319-964e-079f2ee3b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:00.564421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39ee8cc-1cbc-4e06-aa67-052f6683a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:00.568613 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39ee8cc-1cbc-4e06-aa67-052f6683a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446d9882-50fd-4374-ae69-61859481dd88', 'volume_name': 'volume-446d9882-50fd-4374-ae69-61859481dd88', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:00.573840 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f5e064-a027-420d-92ff-1629811b274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:00.581438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f5e064-a027-420d-92ff-1629811b274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:00.586142 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f874e69c-e31d-420e-9338-43ffbc2cf6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:00.587700 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Volume 446d9882-50fd-4374-ae69-61859481dd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446d9882-50fd-4374-ae69-61859481dd88', 'volume_size': 1} Jan 15 21:11:00.587700 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] creating volume 'volume-446d9882-50fd-4374-ae69-61859481dd88' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:00.588570 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:00.686552 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:00.687150 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:00.692171 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f874e69c-e31d-420e-9338-43ffbc2cf6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446d9882-50fd-4374-ae69-61859481dd88', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:00.700415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24f5230-fd22-4176-9707-ead87d362981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:00.719334 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Volume volume-446d9882-50fd-4374-ae69-61859481dd88 (446d9882-50fd-4374-ae69-61859481dd88): created successfully Jan 15 21:11:00.722963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24f5230-fd22-4176-9707-ead87d362981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:00.731350 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (a68caef4-aa2f-4964-8b01-b00ea3a848c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:00.747711 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-04659ef7-bc46-4fa2-b20c-e1c5b4431838 tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:11:01.635976 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] Lock "b'cinder-446d9882-50fd-4374-ae69-61859481dd88-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:01.686978 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:01.793284 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:01.794368 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] Volume volume-446d9882-50fd-4374-ae69-61859481dd88 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:01.808012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-446d9882-50fd-4374-ae69-61859481dd88 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:02.304795 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] Created reservations ['51ab8088-136e-4e9b-b419-2be30759d2bd', 'fb3745fe-1576-4a7f-8171-e40ca578fe18', '802c0ce9-d4fa-4c11-98ae-c5c0efe48639', '1085859a-7232-4440-8929-a7339bebf540'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:02.374647 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:02.441360 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:02.522832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:02.528231 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:11:02.556648 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-222942e5-a792-4141-adbf-0d8d54c61fde tempest-VolumesGetTest-192442191 None] Lock "b'cinder-446d9882-50fd-4374-ae69-61859481dd88-delete_volume'" released by "delete_volume" :: held 0.921s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:02.971587 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-100b5402-65e2-48fe-a8a3-d3e83c15ea06-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:03.042973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:03.170973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:03.186310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:03.626464 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:11:03.655974 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] Volume volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:03.657061 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] deleting parent snapshot volume-100b5402-65e2-48fe-a8a3-d3e83c15ea06.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:11:04.435272 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:04.438488 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:04.438938 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:04.458591 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Flow 'volume_create_manager' (4d79ef2f-a14b-4758-a984-b79b085ab4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:04.466513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129feb51-850a-48bb-815d-c6ba7f19313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:04.502933 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:04.528240 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129feb51-850a-48bb-815d-c6ba7f19313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1350675681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7c4785ec-c5c1-49f6-819f-5913e964634b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cd332db4d54752bdb5e471b5cd39a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:04Z,use_quota=True,user_id='ea4b53cc852c43ccbf82f1b9e662b09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:04.538165 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9644dc4-1675-4417-b21c-dff943695893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:04.543317 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9644dc4-1675-4417-b21c-dff943695893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:04.551818 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d829d845-d0cd-430a-a067-1b7395432f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:04.571765 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d829d845-d0cd-430a-a067-1b7395432f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4785ec-c5c1-49f6-819f-5913e964634b', 'volume_name': 'volume-7c4785ec-c5c1-49f6-819f-5913e964634b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:04.573791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbf334b-1634-4112-967c-3ae1ac4b4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:04.578564 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbf334b-1634-4112-967c-3ae1ac4b4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:04.596148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3165c462-8311-4da7-aba2-0303da0fb7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:04.597151 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Volume 7c4785ec-c5c1-49f6-819f-5913e964634b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4785ec-c5c1-49f6-819f-5913e964634b', 'volume_size': 1} Jan 15 21:11:04.597151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] creating volume 'volume-7c4785ec-c5c1-49f6-819f-5913e964634b' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:04.597151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:04.670176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] Created reservations ['76f3d2e9-886a-4771-bac0-d3598433bf8a', 'b2c710a9-95e3-479e-b02d-220b7882bf08', '16c4c1d0-79c1-46cb-a0cb-346430dc6208', '76fabcb8-2697-41e2-83ac-fc43647a8dae'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:04.720697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:04.721807 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:04.728169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3165c462-8311-4da7-aba2-0303da0fb7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4785ec-c5c1-49f6-819f-5913e964634b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:04.736899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f3418a-8780-4c37-af20-11e421363e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:04.758061 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Volume volume-7c4785ec-c5c1-49f6-819f-5913e964634b (7c4785ec-c5c1-49f6-819f-5913e964634b): created successfully Jan 15 21:11:04.763602 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f3418a-8780-4c37-af20-11e421363e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:04.784150 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Flow 'volume_create_manager' (4d79ef2f-a14b-4758-a984-b79b085ab4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:04.811492 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9349aecc-8c72-4a4e-8b4d-3d0b63e28e81 tempest-VolumesMetadataTest-1004882663 None] Created volume successfully. Jan 15 21:11:04.835077 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:04.910008 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:05.000602 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:05.006847 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:11:05.037660 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d153be4f-2376-4796-b344-d2767da550d2 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-100b5402-65e2-48fe-a8a3-d3e83c15ea06-delete_volume'" released by "delete_volume" :: held 2.065s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:06.683759 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:06.702880 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:06.702880 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:06.778274 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (9b5e26af-95e4-4cee-96ae-3ad18685c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:06.783212 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba6cd0-11ab-4c47-9927-626dfc1b90b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:06.818545 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:06.880630 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba6cd0-11ab-4c47-9927-626dfc1b90b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1282099120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92307a47-0894-4af1-ae2b-bed0787aa158,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:07Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:06.891149 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff628e9-5dce-4c2d-9a85-47249d84f581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:06.907658 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff628e9-5dce-4c2d-9a85-47249d84f581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:06.916613 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98e00aa-3824-4a46-beb8-e32b3b2b8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:06.948825 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] Lock "b'cinder-7c4785ec-c5c1-49f6-819f-5913e964634b-delete_volume'" acquired by "delete_volume" :: waited 0.083s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:07.060014 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:07.149740 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:07.150419 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] Volume volume-7c4785ec-c5c1-49f6-819f-5913e964634b is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:07.159748 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] deleting rbd volume volume-7c4785ec-c5c1-49f6-819f-5913e964634b {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:07.206301 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98e00aa-3824-4a46-beb8-e32b3b2b8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92307a47-0894-4af1-ae2b-bed0787aa158', 'volume_name': 'volume-92307a47-0894-4af1-ae2b-bed0787aa158', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:07.212309 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569304e9-c9eb-4795-90a7-c70cbe983275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:07.223315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569304e9-c9eb-4795-90a7-c70cbe983275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:07.236712 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502ba323-15b3-485f-b827-48c5d85665d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:07.239606 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Volume 92307a47-0894-4af1-ae2b-bed0787aa158: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92307a47-0894-4af1-ae2b-bed0787aa158', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:11:07.240595 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Cloning 92307a47-0894-4af1-ae2b-bed0787aa158 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:11:07.265173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:07.284885 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 11, 7, 271241)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:11:07.285339 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:11:07.287268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:11:07.298768 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:07.300564 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:11:07.312334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 11, 7, 307373)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:11:07.313191 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:11:07.313904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:11:07.332367 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:07.436501 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] creating snapshot='volume-92307a47-0894-4af1-ae2b-bed0787aa158.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:11:08.416902 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-92307a47-0894-4af1-ae2b-bed0787aa158.clone_snap' to 'volume-92307a47-0894-4af1-ae2b-bed0787aa158' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:11:08.476969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] Created reservations ['016afcbf-e6af-4d36-835a-28a3f0dab7c7', '7ab3f25d-138d-48f1-b249-26c204863061', '7e5fa9c7-5df5-4c3d-b649-32fd80b9014d', '353fc591-125f-4063-995b-e7f87eec65f1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:08.564909 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:08.622774 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:08.668988 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:08.675341 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] Deleted volume successfully. Jan 15 21:11:08.731067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:08.732394 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:08.732812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:08.754465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:11:08.755271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Marking volume 92307a47-0894-4af1-ae2b-bed0787aa158 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:11:08.769236 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c3cbe302-384a-4b1d-90d8-201fe4708944 tempest-VolumesMetadataTest-1004882663 None] Lock "b'cinder-7c4785ec-c5c1-49f6-819f-5913e964634b-delete_volume'" released by "delete_volume" :: held 1.823s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:08.785685 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 92307a47-0894-4af1-ae2b-bed0787aa158. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:11:08.786245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Creating volume glance metadata for volume 92307a47-0894-4af1-ae2b-bed0787aa158 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:11:08.998641 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502ba323-15b3-485f-b827-48c5d85665d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92307a47-0894-4af1-ae2b-bed0787aa158', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:09.013497 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f97742-8e88-4d93-b170-204e709c780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:09.039902 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Volume volume-92307a47-0894-4af1-ae2b-bed0787aa158 (92307a47-0894-4af1-ae2b-bed0787aa158): created successfully Jan 15 21:11:09.044357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f97742-8e88-4d93-b170-204e709c780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:09.050961 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (9b5e26af-95e4-4cee-96ae-3ad18685c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:09.061488 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1cca83d8-7ec4-4ecd-bfda-38d10459106d tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:11:11.080704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:11.089469 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:11.092649 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:11.143164 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (84ab5697-53e7-4207-b5e0-8c7e5766dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:11.151092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9634c763-e91e-4333-80bd-44fd5279978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:11.165391 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:11.185009 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9634c763-e91e-4333-80bd-44fd5279978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-243544844',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e46215c3-95c2-4d8f-b49a-ebac754fd9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92f944f1b94ee58ec0e4257d63d457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:11Z,use_quota=True,user_id='3d32bfa8c13547599691707e1646121f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:11.190916 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf111db-1826-43b3-845f-191d0d1a9288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:11.197756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf111db-1826-43b3-845f-191d0d1a9288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:11.207072 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e033eb-efc1-4ab7-a235-cce1e74c8ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:11.211986 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e033eb-efc1-4ab7-a235-cce1e74c8ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46215c3-95c2-4d8f-b49a-ebac754fd9ff', 'volume_name': 'volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:11.219610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb44886f-8424-4e52-adaf-74794cd9f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:11.241045 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb44886f-8424-4e52-adaf-74794cd9f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:11.248713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b8454-0b69-43c1-85a6-5c9ebfeb8c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:11.250933 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Volume e46215c3-95c2-4d8f-b49a-ebac754fd9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff', 'volume_size': 1} Jan 15 21:11:11.251459 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] creating volume 'volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:11.252580 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:11.393446 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:11.393824 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:11.397708 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b8454-0b69-43c1-85a6-5c9ebfeb8c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:11.408528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be6dc4c-d894-41b3-8c42-17a4c38ac7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:11.433584 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Volume volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff (e46215c3-95c2-4d8f-b49a-ebac754fd9ff): created successfully Jan 15 21:11:11.444834 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be6dc4c-d894-41b3-8c42-17a4c38ac7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:11.450851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Flow 'volume_create_manager' (84ab5697-53e7-4207-b5e0-8c7e5766dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:11.479534 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ed809f40-dd9c-483b-95c8-faac41ed8518 tempest-VolumesGetTest-192442191 None] Created volume successfully. Jan 15 21:11:11.969050 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-e46215c3-95c2-4d8f-b49a-ebac754fd9ff-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:12.077844 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:12.166778 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:12.167427 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] Volume volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:12.180043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-e46215c3-95c2-4d8f-b49a-ebac754fd9ff {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:12.661156 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] Created reservations ['3aba6ab2-ebbf-4bfc-846a-56b2ea4055f2', '6b526c6f-52c6-4ae5-9048-19ea17327b0a', '3deb97d3-556c-4deb-9102-e270a3afd7fd', '25c444e9-8ca7-43b0-bb7e-5cd49f3c6ccc'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:12.834891 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:12.919541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:13.002936 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:13.018518 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:11:13.047938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-134304d2-0876-4e5f-9f98-d99db611bdb3 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-e46215c3-95c2-4d8f-b49a-ebac754fd9ff-delete_volume'" released by "delete_volume" :: held 1.079s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:13.216407 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] Lock "b'cinder-92307a47-0894-4af1-ae2b-bed0787aa158-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:13.287350 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:13.429400 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:13.448059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-92307a47-0894-4af1-ae2b-bed0787aa158 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:13.807902 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e48dfd0f-fb81-473e-ab8e-a0f9098e7a0c tempest-VolumesActionsTest-777683023 None] Uploaded volume to glance image-id: 2d953b87-ceaa-47ae-8084-3259fb84f6e0. {{(pid=122725) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Jan 15 21:11:13.811883 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:11:13.849567 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] deleting parent snapshot volume-92307a47-0894-4af1-ae2b-bed0787aa158.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:11:14.525615 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e48dfd0f-fb81-473e-ab8e-a0f9098e7a0c tempest-VolumesActionsTest-777683023 None] Copy volume to image completed successfully. Jan 15 21:11:14.548147 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:14.551537 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:14.552049 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:14.571670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Flow 'volume_create_manager' (3cc895c4-64da-4636-83e0-ef8f52db8407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:14.578701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f198855-c5ad-4c7e-9988-65f73d0fa855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:14.591982 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:14.595555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] Created reservations ['413e0c98-e3dd-45c0-9d05-3b99bd7dd247', 'e6d28683-24d8-42a8-a26f-bb65b1327c88', '87a7b857-1567-4f9f-a397-9c3990b8deff', '34c0c7fb-48d7-46ed-aa55-224d781a071f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:14.610212 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f198855-c5ad-4c7e-9988-65f73d0fa855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2061372088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c02f8a1d-b762-40be-9f64-e353ef1c9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581f23bb65c648408f2707a199a990e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:14Z,use_quota=True,user_id='3b33ce60fd114adf982f585dde34ed04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:14.615693 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d731e-2eba-4a10-b7d3-5b49a6ff0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:14.620213 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d731e-2eba-4a10-b7d3-5b49a6ff0d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:14.626118 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f707541-46d1-498b-9f0c-86f987bedd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:14.630375 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f707541-46d1-498b-9f0c-86f987bedd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'volume_name': 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:14.635313 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3faf4e-5ab9-4c63-8ada-25a3370e73b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:14.639635 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3faf4e-5ab9-4c63-8ada-25a3370e73b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:14.644363 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc3fdf9-0d8a-4500-ac29-5b2244489360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:14.646158 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Volume c02f8a1d-b762-40be-9f64-e353ef1c9a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'volume_size': 1} Jan 15 21:11:14.646867 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] creating volume 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:14.648646 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:14.715478 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:14.716119 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:14.720485 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc3fdf9-0d8a-4500-ac29-5b2244489360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:14.725131 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ebcbcc-6bad-40e4-949d-1c069ec1ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:14.737168 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Volume volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98 (c02f8a1d-b762-40be-9f64-e353ef1c9a98): created successfully Jan 15 21:11:14.740772 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ebcbcc-6bad-40e4-949d-1c069ec1ef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:14.746551 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Flow 'volume_create_manager' (3cc895c4-64da-4636-83e0-ef8f52db8407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:14.755275 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:14.783756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:14.812442 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:14.814970 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8d39501d-1303-4e10-99cd-2760d33e181b tempest-VolumesBackupsTest-197440665 None] Created volume successfully. Jan 15 21:11:14.820280 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:11:14.832207 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-082bbfdc-c2f0-43ff-a03e-9dc91989795a tempest-VolumesGetTest-192442191 None] Lock "b'cinder-92307a47-0894-4af1-ae2b-bed0787aa158-delete_volume'" released by "delete_volume" :: held 1.616s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:15.543099 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-6e15a700-bcc2-4a69-ab7e-e3afae34db53-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:15.628948 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:15.696615 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:15.697805 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] Volume volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:15.711828 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] deleting rbd volume volume-6e15a700-bcc2-4a69-ab7e-e3afae34db53 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:15.943055 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:16.007407 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:16.077146 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:16.077768 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] Volume volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:16.085655 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] deleting rbd volume volume-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:16.147288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] Created reservations ['cd10790d-2c66-412e-adfe-c7acca7c4cf7', '61a52a0b-9b72-4e64-9139-62d75ecd9f2d', '7c68c72f-de4a-450c-8495-db885618b9e3', '27e3470e-a24f-4882-b853-621915f18cbc'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:16.233245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:16.281190 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:16.369122 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:16.383244 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] Deleted volume successfully. Jan 15 21:11:16.399637 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-586fe817-086c-4246-99f9-dc0501e44825 tempest-VolumesGetTest-192442191 None] Lock "b'cinder-6e15a700-bcc2-4a69-ab7e-e3afae34db53-delete_volume'" released by "delete_volume" :: held 0.857s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:16.514697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] Created reservations ['3a102cf8-cb6a-4594-a48b-13c2a763898e', 'd1a0360c-45cc-407e-ac52-52c68f12eaed', '9862f1e5-d7f2-4521-bf4a-6c4ae45eebdd', '4affebd1-fbe9-4ffa-acb5-9de9fde9ec13'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:16.587786 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:16.649773 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:16.708383 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:16.717006 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] Deleted volume successfully. Jan 15 21:11:16.741129 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b12a7eb4-bfc4-40d8-a091-a3c9ec6ef0c6 tempest-VolumesActionsTest-777683023 None] Lock "b'cinder-ab439b55-6b3f-4bb3-a9a7-727b7ad7d7ac-delete_volume'" released by "delete_volume" :: held 0.796s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:17.522623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-92e0f4fe-fdac-4a90-a811-870d5243b82d tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['69b330d6-39a3-488d-bb6c-a22c1fc2aee1', '8b12134a-2cf8-4ded-8d6a-c208b7c2ae71', '4ff607c3-d79e-45b9-a1b2-25b0375e32e5', 'dcb96d15-a3aa-4441-9eae-0941e8c26274'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:17.588298 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-92e0f4fe-fdac-4a90-a811-870d5243b82d tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:11:17.596081 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-92e0f4fe-fdac-4a90-a811-870d5243b82d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-685511a0-015c-44e6-b7e7-1238bf85c209-delete_snapshot'" released by "delete_snapshot" :: held 30.386s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:18.140542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-57d1caf8-2170-4774-aa82-35f8e014950c tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-6f35d88e-b0ae-4339-b9f2-c382f4978c20-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:18.143721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-57d1caf8-2170-4774-aa82-35f8e014950c tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:21.173096 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:21.177506 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:21.178178 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:21.201607 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Flow 'volume_create_manager' (9015d132-21fb-4dc3-bd52-498074ebe640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:21.210390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d977bb74-468a-47f1-a7e0-24c14f808a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:21.218415 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:21.238637 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d977bb74-468a-47f1-a7e0-24c14f808a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-631316612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4babe18-9c61-4a97-bdcf-7baefe8b95c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696d8933bc8244f8b94f6a40640388e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:21Z,use_quota=True,user_id='3a12e8599173445e89137620188b4b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:21.246115 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8f0ff1-2565-4c44-8abb-3beb40c7b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:21.252341 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8f0ff1-2565-4c44-8abb-3beb40c7b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:21.259333 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83b1f12-5da5-4b03-aacf-b3c565b4de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:21.264824 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83b1f12-5da5-4b03-aacf-b3c565b4de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4babe18-9c61-4a97-bdcf-7baefe8b95c7', 'volume_name': 'volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7', 'volume_size': 2}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:21.271535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738c7bcd-5286-4c40-a68a-ecb118757b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:21.277347 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738c7bcd-5286-4c40-a68a-ecb118757b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:21.283664 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6244b1f-adf6-4726-bc4f-a714c30b2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:21.285232 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Volume f4babe18-9c61-4a97-bdcf-7baefe8b95c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7', 'volume_size': 2} Jan 15 21:11:21.285841 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] creating volume 'volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:21.287070 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:21.454237 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:21.454859 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:21.459525 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6244b1f-adf6-4726-bc4f-a714c30b2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7', 'volume_size': 2}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:21.464751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a88131-699d-4e40-95b2-cc012c164977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:21.474785 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Volume volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7 (f4babe18-9c61-4a97-bdcf-7baefe8b95c7): created successfully Jan 15 21:11:21.480864 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a88131-699d-4e40-95b2-cc012c164977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:21.488980 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Flow 'volume_create_manager' (9015d132-21fb-4dc3-bd52-498074ebe640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:21.501226 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-fb22a4a5-7a14-4e3b-bc4e-2b540b00c49e tempest-VolumesCloneNegativeTest-833599224 None] Created volume successfully. Jan 15 21:11:22.271833 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] Lock "b'cinder-f4babe18-9c61-4a97-bdcf-7baefe8b95c7-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:22.326028 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:22.389756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:22.390364 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] Volume volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:22.409733 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] deleting rbd volume volume-f4babe18-9c61-4a97-bdcf-7baefe8b95c7 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:22.803434 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] Created reservations ['332c555e-a0de-44ad-87c2-110aa0258bbd', 'eb9175df-4d1a-479b-8102-0637a3ba1df7', 'e9aedb66-67f7-4808-b004-2b26763fc817', 'c1478830-b80c-484b-8e88-e7d4143b7857'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:22.876367 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:22.926039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:22.983036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:22.989464 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] Deleted volume successfully. Jan 15 21:11:23.006344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4e8ebae9-b903-4cf6-b743-cbd51a457d24 tempest-VolumesCloneNegativeTest-833599224 None] Lock "b'cinder-f4babe18-9c61-4a97-bdcf-7baefe8b95c7-delete_volume'" released by "delete_volume" :: held 0.735s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:26.864085 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:26.868941 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:26.869606 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:26.894826 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Flow 'volume_create_manager' (e9e54658-508f-40ca-966d-88e112db7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:26.903724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c43bb0-4012-4285-8a72-3516dc7af9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:26.919426 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:26.953972 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c43bb0-4012-4285-8a72-3516dc7af9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1411452174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=09e762d6-f79b-4655-adb9-75e75c1307f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='388989507e934dd2bd8c2e4a192e027d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:27Z,use_quota=True,user_id='1b5a1ca018954b6d94629cd65bf87bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:26.965141 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d63498-c986-42bd-a144-2aea9a21c95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:26.970474 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d63498-c986-42bd-a144-2aea9a21c95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:26.977542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ee1e7a-f626-48ac-9ec5-8f9b335fa388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:27.097791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ee1e7a-f626-48ac-9ec5-8f9b335fa388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09e762d6-f79b-4655-adb9-75e75c1307f0', 'volume_name': 'volume-09e762d6-f79b-4655-adb9-75e75c1307f0', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:27.104715 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1ef006-e8b9-4b05-bd5d-49934b13c030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:27.111478 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1ef006-e8b9-4b05-bd5d-49934b13c030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:27.118208 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c409b09c-5f57-4f2b-a167-9b109cff052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:27.119616 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Volume 09e762d6-f79b-4655-adb9-75e75c1307f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09e762d6-f79b-4655-adb9-75e75c1307f0', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:11:27.120784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Cloning 09e762d6-f79b-4655-adb9-75e75c1307f0 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:11:27.132996 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:27.144357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 11, 27, 138207)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:11:27.145008 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:11:27.145704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:11:27.151426 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:27.152548 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:11:27.168120 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 11, 27, 157008)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:11:27.168760 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:11:27.169378 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:11:27.185783 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:27.290571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] creating snapshot='volume-09e762d6-f79b-4655-adb9-75e75c1307f0.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:11:28.377498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-09e762d6-f79b-4655-adb9-75e75c1307f0.clone_snap' to 'volume-09e762d6-f79b-4655-adb9-75e75c1307f0' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:11:28.589618 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:28.591541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:28.592105 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:28.626439 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:11:28.627036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Marking volume 09e762d6-f79b-4655-adb9-75e75c1307f0 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:11:28.639592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 09e762d6-f79b-4655-adb9-75e75c1307f0. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:11:28.640275 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Creating volume glance metadata for volume 09e762d6-f79b-4655-adb9-75e75c1307f0 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:11:28.761578 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c409b09c-5f57-4f2b-a167-9b109cff052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e762d6-f79b-4655-adb9-75e75c1307f0', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:28.778207 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e48f1d-0412-4ce0-bd95-176bdf3772ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:28.788923 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Volume volume-09e762d6-f79b-4655-adb9-75e75c1307f0 (09e762d6-f79b-4655-adb9-75e75c1307f0): created successfully Jan 15 21:11:28.793904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e48f1d-0412-4ce0-bd95-176bdf3772ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:28.800594 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Flow 'volume_create_manager' (e9e54658-508f-40ca-966d-88e112db7577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:28.812661 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c1ab9f18-794a-42cc-880a-89cd6f097690 tempest-VolumesExtendTest-952651143 None] Created volume successfully. Jan 15 21:11:29.058252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35ff1e7b-12b8-4c35-8840-a76e2088f5a6 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:29.229058 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35ff1e7b-12b8-4c35-8840-a76e2088f5a6 tempest-VolumesExtendTest-952651143 None] Extend volume from 1 GB to 2 GB. {{(pid=122725) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Jan 15 21:11:29.263651 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-35ff1e7b-12b8-4c35-8840-a76e2088f5a6 tempest-VolumesExtendTest-952651143 None] Extend volume completed successfully. Jan 15 21:11:30.908524 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:30.915273 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:30.916022 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:30.945639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Flow 'volume_create_manager' (825a5c19-67af-4915-9f2b-bce4c9b80527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:30.959021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad170576-1525-49bb-b929-35f3d457db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:30.967719 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:30.989400 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad170576-1525-49bb-b929-35f3d457db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-60616743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9c67d49-09d8-4cb3-819e-4101abdf9f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='388989507e934dd2bd8c2e4a192e027d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:31Z,use_quota=True,user_id='1b5a1ca018954b6d94629cd65bf87bec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:31.002393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aac587c-2014-4ae4-bfa9-349212ade5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:31.012076 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aac587c-2014-4ae4-bfa9-349212ade5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:31.020658 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa39083d-9839-441e-b5ba-28e503649c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:31.027974 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa39083d-9839-441e-b5ba-28e503649c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c67d49-09d8-4cb3-819e-4101abdf9f12', 'volume_name': 'volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:31.041958 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aae7e4-bfb4-4f58-add9-4027e9bd1c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:31.054945 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aae7e4-bfb4-4f58-add9-4027e9bd1c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:31.059684 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f8f3b-c2b0-405e-8c6c-f8a87c8fabdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:31.062081 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Volume f9c67d49-09d8-4cb3-819e-4101abdf9f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12', 'volume_size': 1} Jan 15 21:11:31.062815 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] creating volume 'volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:31.064266 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:31.147888 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:31.148630 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:31.153498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f8f3b-c2b0-405e-8c6c-f8a87c8fabdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:31.159219 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf7852a-730f-4266-aa20-fba6f7a252a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:31.171225 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Volume volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12 (f9c67d49-09d8-4cb3-819e-4101abdf9f12): created successfully Jan 15 21:11:31.175941 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf7852a-730f-4266-aa20-fba6f7a252a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:31.182717 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Flow 'volume_create_manager' (825a5c19-67af-4915-9f2b-bce4c9b80527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:31.192935 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ca769cfd-5c06-4723-ba8a-dd4925317713 tempest-VolumesExtendTest-952651143 None] Created volume successfully. Jan 15 21:11:31.964491 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8fee27d2-331a-4453-a3d7-12a8dd83a370 req-5db11fa1-e954-4a14-9173-201872054c99 tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:11:32.227008 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a949ecbb-c40b-4156-9bb4-956559aa7ece tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:32.519424 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a949ecbb-c40b-4156-9bb4-956559aa7ece tempest-VolumesExtendTest-952651143 None] Create snapshot completed successfully Jan 15 21:11:33.259850 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-8fee27d2-331a-4453-a3d7-12a8dd83a370 req-5db11fa1-e954-4a14-9173-201872054c99 tempest-VolumesBackupsTest-197440665 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.296s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:11:33.260649 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-8fee27d2-331a-4453-a3d7-12a8dd83a370 req-5db11fa1-e954-4a14-9173-201872054c99 tempest-VolumesBackupsTest-197440665 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:11:33.296048 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-8fee27d2-331a-4453-a3d7-12a8dd83a370 req-5db11fa1-e954-4a14-9173-201872054c99 tempest-VolumesBackupsTest-197440665 None] Connection info returned from driver {'name': 'volumes/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '06dbb7e4-41ca-438b-93be-498beea90a80'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:11:33.460671 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-8fee27d2-331a-4453-a3d7-12a8dd83a370 req-5db11fa1-e954-4a14-9173-201872054c99 tempest-VolumesBackupsTest-197440665 None] attachment_update completed successfully. Jan 15 21:11:33.531531 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-818bcd30-b282-4f9f-8e0d-b4f905608fc5 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:33.728825 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-818bcd30-b282-4f9f-8e0d-b4f905608fc5 tempest-VolumesExtendTest-952651143 None] Extend volume from 1 GB to 2 GB. {{(pid=122725) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1732}} Jan 15 21:11:33.796454 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-818bcd30-b282-4f9f-8e0d-b4f905608fc5 tempest-VolumesExtendTest-952651143 None] Extend volume completed successfully. Jan 15 21:11:34.951892 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-385a19c2-f0ef-4c3b-820a-aa1873270035 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-782afa28-eae8-4253-ae6b-aa0c738d1986-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.036s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:34.954180 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-385a19c2-f0ef-4c3b-820a-aa1873270035 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:35.645765 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-385a19c2-f0ef-4c3b-820a-aa1873270035 tempest-VolumesExtendTest-952651143 None] Created reservations ['3fe36ec6-237a-4637-95f6-dc1ff1dae33a', 'adba2b1e-9e29-4865-82fc-871757566fbe', '375f1083-4981-4950-a99c-b0dd7847365f', '9726ddd3-cd19-489a-a95b-a76c16e86c95'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:35.728127 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-385a19c2-f0ef-4c3b-820a-aa1873270035 tempest-VolumesExtendTest-952651143 None] Delete snapshot completed successfully. Jan 15 21:11:35.734605 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-385a19c2-f0ef-4c3b-820a-aa1873270035 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-782afa28-eae8-4253-ae6b-aa0c738d1986-delete_snapshot'" released by "delete_snapshot" :: held 0.783s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:35.910884 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:11:36.174511 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-f9c67d49-09d8-4cb3-819e-4101abdf9f12-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:36.270381 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:36.395814 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:36.396327 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] Volume volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:36.404908 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] deleting rbd volume volume-f9c67d49-09d8-4cb3-819e-4101abdf9f12 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:36.780712 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] Created reservations ['338747aa-c6b0-43f3-8b6b-337016a252bb', '0ad31b20-b222-406c-8309-a6ed62a6167c', '273afccf-02a2-435d-acff-2582ae6598b0', '8a50c7ae-19d8-40ce-89f6-8602f3565549'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:36.852420 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:36.911758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:36.980930 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:36.985371 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] Deleted volume successfully. Jan 15 21:11:36.998351 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-95f5d069-d9aa-41c8-bd50-49e34e372ff5 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-f9c67d49-09d8-4cb3-819e-4101abdf9f12-delete_volume'" released by "delete_volume" :: held 0.824s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:37.190899 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.280s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:11:37.191597 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'c02f8a1d-b762-40be-9f64-e353ef1c9a98', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:11:37.207174 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Initialize volume connection completed successfully. Jan 15 21:11:37.443391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-09e762d6-f79b-4655-adb9-75e75c1307f0-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:37.530714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:37.673279 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:11:37.685636 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] deleting rbd volume volume-09e762d6-f79b-4655-adb9-75e75c1307f0 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:38.029713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:11:38.087465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] deleting parent snapshot volume-09e762d6-f79b-4655-adb9-75e75c1307f0.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:11:39.208326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] Created reservations ['1a2c6eab-edeb-40e2-a220-532fd163dc82', 'd8344f21-bccc-472f-b885-edeeac643f75', '47d46a83-432b-4d3d-abe4-bfbe2d002695', '40f71bc9-f35d-42ed-9216-803f3345ee75'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:39.283971 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:39.367375 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:39.437452 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:39.446190 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] Deleted volume successfully. Jan 15 21:11:39.484114 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Terminate volume connection completed successfully. Jan 15 21:11:39.496535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c99923e7-bb55-41b4-9834-cfd82196b017 tempest-VolumesExtendTest-952651143 None] Lock "b'cinder-09e762d6-f79b-4655-adb9-75e75c1307f0-delete_volume'" released by "delete_volume" :: held 2.053s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:39.514486 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f27268df-7eef-4d34-8e1e-2d52683d451b tempest-VolumesBackupsTest-197440665 None] Remove volume export completed successfully. Jan 15 21:11:41.307763 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:11:41.310277 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:41.419005 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:41.489482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:43.179702 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-68367172-5d26-4e36-8abb-4fe60ea9a3bf req-a987d0ba-ac37-457a-9abd-1c0255b8af2e tempest-VolumesBackupsTest-197440665 None] Terminate volume connection completed successfully. Jan 15 21:11:43.181194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-68367172-5d26-4e36-8abb-4fe60ea9a3bf req-a987d0ba-ac37-457a-9abd-1c0255b8af2e tempest-VolumesBackupsTest-197440665 None] Deleting attachment 06dbb7e4-41ca-438b-93be-498beea90a80. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:11:44.734679 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:44.740800 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:44.741566 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:44.795229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Flow 'volume_create_manager' (f8691ecb-8b6b-41a8-8f4b-8d226b89d3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:44.806298 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060b66aa-c5cc-4bb1-bd2a-a378ec85f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:44.827797 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:44.862066 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060b66aa-c5cc-4bb1-bd2a-a378ec85f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-385285899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=680136ee-dc5c-494d-8bb3-674694ee9512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e469a5c2748947d2b8a9103dafc74172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:45Z,use_quota=True,user_id='941792efba534f3eb072b727046cfdc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:44.888353 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9dcc78-d61a-4be6-9342-fb71b1a28db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:44.893043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9dcc78-d61a-4be6-9342-fb71b1a28db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:44.898576 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe68b27-4806-474b-b0fa-b6c2c835ec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:44.903971 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe68b27-4806-474b-b0fa-b6c2c835ec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680136ee-dc5c-494d-8bb3-674694ee9512', 'volume_name': 'volume-680136ee-dc5c-494d-8bb3-674694ee9512', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:44.911151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbec43d5-bd4f-4108-85d0-b055caf5e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:44.918867 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbec43d5-bd4f-4108-85d0-b055caf5e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:44.942727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5e645-3981-4c52-9063-eed0744b5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:44.944234 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Volume 680136ee-dc5c-494d-8bb3-674694ee9512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680136ee-dc5c-494d-8bb3-674694ee9512', 'volume_size': 1} Jan 15 21:11:44.946749 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] creating volume 'volume-680136ee-dc5c-494d-8bb3-674694ee9512' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:11:44.949609 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:45.060450 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:45.061164 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:45.065397 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5e645-3981-4c52-9063-eed0744b5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680136ee-dc5c-494d-8bb3-674694ee9512', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:45.072429 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9c16f6-9a9e-4cc0-a63d-a0fb44e5b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:45.083081 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Volume volume-680136ee-dc5c-494d-8bb3-674694ee9512 (680136ee-dc5c-494d-8bb3-674694ee9512): created successfully Jan 15 21:11:45.089133 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9c16f6-9a9e-4cc0-a63d-a0fb44e5b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:45.107758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Flow 'volume_create_manager' (f8691ecb-8b6b-41a8-8f4b-8d226b89d3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:45.127189 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ad0fd857-0956-41a0-b3db-8de42e71d107 tempest-VolumesNegativeTest-263050443 None] Created volume successfully. Jan 15 21:11:48.360222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-57d1caf8-2170-4774-aa82-35f8e014950c tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['4a916285-c9ab-42fa-b6ce-259348f95902', 'f5409e1e-1860-48f2-baa4-70a89ae9a442', '02249171-e0ad-408a-9a4f-a6f93436c7b8', '88943635-1f0e-4716-8190-d2cb6728dc04'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:48.410268 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-57d1caf8-2170-4774-aa82-35f8e014950c tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:11:48.440240 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-57d1caf8-2170-4774-aa82-35f8e014950c tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-6f35d88e-b0ae-4339-b9f2-c382f4978c20-delete_snapshot'" released by "delete_snapshot" :: held 30.301s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:48.638498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-6cc5a220-6f3e-44cc-a799-b1f62499c03d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-8092b85d-4044-431d-93dc-ea37d2b24561-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:48.640769 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6cc5a220-6f3e-44cc-a799-b1f62499c03d tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:49.828771 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-c02f8a1d-b762-40be-9f64-e353ef1c9a98-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:49.879340 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:50.354541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] Volume volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:50.374001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] deleting rbd volume volume-c02f8a1d-b762-40be-9f64-e353ef1c9a98 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:11:50.776891 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] Created reservations ['e1a4b505-fbae-4250-a733-b0402567277e', '71a35d9d-47ff-4cd3-a270-cfd9dc21132b', 'b395ceb5-b1a8-4a20-80ed-b343910375d0', '4fb4c598-b16b-4977-9b7a-87636ca47d4b'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:11:50.842591 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:50.958932 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:51.053146 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:11:51.059705 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] Deleted volume successfully. Jan 15 21:11:51.090123 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8d85e02b-8253-473c-a937-45be804a581d tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-c02f8a1d-b762-40be-9f64-e353ef1c9a98-delete_volume'" released by "delete_volume" :: held 1.261s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:51.937933 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:11:51.943952 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:11:51.944446 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:11:51.976492 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Flow 'volume_create_manager' (ecb03153-e56a-4fc5-a101-d0cf9e90fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:51.983829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684bff31-c734-4cbd-971b-03825f3fb63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:51.993181 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:11:52.012381 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684bff31-c734-4cbd-971b-03825f3fb63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-581721069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=730ab34e-1940-4999-811d-3fd7a179af20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581f23bb65c648408f2707a199a990e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:11:52Z,use_quota=True,user_id='3b33ce60fd114adf982f585dde34ed04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:52.020513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d3f15e-8355-4c04-af2b-6c5e221d4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:52.026131 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d3f15e-8355-4c04-af2b-6c5e221d4a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:52.032545 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51994e2-e3bb-4647-94ce-8292cffc1f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:52.137835 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51994e2-e3bb-4647-94ce-8292cffc1f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '730ab34e-1940-4999-811d-3fd7a179af20', 'volume_name': 'volume-730ab34e-1940-4999-811d-3fd7a179af20', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:52.143207 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5db86f-ffd3-4ef0-b13f-56cb3a271e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:52.147855 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5db86f-ffd3-4ef0-b13f-56cb3a271e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:52.153411 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1e87b3-9daa-4d9e-906e-740b371c41fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:52.154919 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Volume 730ab34e-1940-4999-811d-3fd7a179af20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-730ab34e-1940-4999-811d-3fd7a179af20', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:11:52.155892 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Cloning 730ab34e-1940-4999-811d-3fd7a179af20 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:11:52.174318 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:11:52.190195 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 11, 52, 178943)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:11:52.190527 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:11:52.191161 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:11:52.196168 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:11:52.197382 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:11:52.205829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 11, 52, 202599)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:11:52.206490 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:11:52.206962 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:11:52.220662 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:11:52.288682 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] creating snapshot='volume-730ab34e-1940-4999-811d-3fd7a179af20.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:11:52.404648 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-730ab34e-1940-4999-811d-3fd7a179af20.clone_snap' to 'volume-730ab34e-1940-4999-811d-3fd7a179af20' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:11:52.626316 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:11:52.628582 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:11:52.628991 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:11:52.657112 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:11:52.658025 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Marking volume 730ab34e-1940-4999-811d-3fd7a179af20 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:11:52.668162 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 730ab34e-1940-4999-811d-3fd7a179af20. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:11:52.669319 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Creating volume glance metadata for volume 730ab34e-1940-4999-811d-3fd7a179af20 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:11:52.736745 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1e87b3-9daa-4d9e-906e-740b371c41fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730ab34e-1940-4999-811d-3fd7a179af20', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:52.742463 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afd75bb-22b1-4a21-9b8e-d73e518a0a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:11:52.762161 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Volume volume-730ab34e-1940-4999-811d-3fd7a179af20 (730ab34e-1940-4999-811d-3fd7a179af20): created successfully Jan 15 21:11:52.767668 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afd75bb-22b1-4a21-9b8e-d73e518a0a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:11:52.776626 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Flow 'volume_create_manager' (ecb03153-e56a-4fc5-a101-d0cf9e90fac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:11:52.799211 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3a740ceb-408a-476e-a63e-e2de5e8239f3 tempest-VolumesBackupsTest-197440665 None] Created volume successfully. Jan 15 21:11:53.346558 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:11:54.106702 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.760s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:11:54.107591 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-730ab34e-1940-4999-811d-3fd7a179af20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '730ab34e-1940-4999-811d-3fd7a179af20', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:11:54.123100 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Initialize volume connection completed successfully. Jan 15 21:12:02.844695 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Terminate volume connection completed successfully. Jan 15 21:12:02.878648 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f8ae25b6-7a99-4cac-bab9-0e3b76e68c4a tempest-VolumesBackupsTest-197440665 None] Remove volume export completed successfully. Jan 15 21:12:04.053032 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:04.058759 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:04.059314 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:04.090949 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Flow 'volume_create_manager' (5d79efe3-96ce-4df7-a19f-07a92e459447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:04.099267 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3752e677-93d3-40ea-b595-4c0fcf1a4236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:04.107462 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:04.128180 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3752e677-93d3-40ea-b595-4c0fcf1a4236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:04Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_2ad47dfe-18ff-4c2b-a6db-4842f546a610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3b97ba69-58fd-4c51-a8ae-7ab354daf8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581f23bb65c648408f2707a199a990e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:04Z,use_quota=True,user_id='3b33ce60fd114adf982f585dde34ed04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:04.133732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db04535b-b90e-48bd-8a93-013e45b45e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:04.138625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db04535b-b90e-48bd-8a93-013e45b45e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:04.145166 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eeda8d-5e7d-45fe-bcd5-be3114b88686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:04.149651 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eeda8d-5e7d-45fe-bcd5-be3114b88686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'volume_name': 'volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:04.155335 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811192cc-3a1b-4d9d-b1dd-6047d7a29e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:04.161217 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811192cc-3a1b-4d9d-b1dd-6047d7a29e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:04.167232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fa54b8-8a97-4478-a518-d94c1b32b987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:04.168536 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Volume 3b97ba69-58fd-4c51-a8ae-7ab354daf8ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'volume_size': 1} Jan 15 21:12:04.169148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] creating volume 'volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:12:04.170454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:04.268099 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:04.268610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:04.273503 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fa54b8-8a97-4478-a518-d94c1b32b987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:04.280894 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875565ff-0a5e-44d6-88e9-f2600695fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:04.293458 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Volume volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec (3b97ba69-58fd-4c51-a8ae-7ab354daf8ec): created successfully Jan 15 21:12:04.302430 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875565ff-0a5e-44d6-88e9-f2600695fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:04.309493 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Flow 'volume_create_manager' (5d79efe3-96ce-4df7-a19f-07a92e459447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:04.321223 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Created volume successfully. Jan 15 21:12:05.290300 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:12:06.152166 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.862s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:12:06.153554 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '3b97ba69-58fd-4c51-a8ae-7ab354daf8ec', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:12:06.177188 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Initialize volume connection completed successfully. Jan 15 21:12:10.280872 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] Lock "b'cinder-680136ee-dc5c-494d-8bb3-674694ee9512-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:10.369819 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:10.478727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:10.479153 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] Volume volume-680136ee-dc5c-494d-8bb3-674694ee9512 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:10.495505 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] deleting rbd volume volume-680136ee-dc5c-494d-8bb3-674694ee9512 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:11.144016 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] Created reservations ['d359b2e3-b61c-4ed1-95a4-45987867c173', '980f3f35-b89d-4dcf-93b1-07f8816c0e2e', '54a2f66f-bc7d-4248-a93a-b8f9bc6fbbfb', '112c1e9e-1072-4205-8d26-ea0075b19c0b'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:11.222221 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:11.276544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:11.345499 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:11.352085 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] Deleted volume successfully. Jan 15 21:12:11.372313 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1d0c08ec-06a8-4e21-9c9a-a34c5bd0770b tempest-VolumesNegativeTest-263050443 None] Lock "b'cinder-680136ee-dc5c-494d-8bb3-674694ee9512-delete_volume'" released by "delete_volume" :: held 1.091s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:11.990781 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Terminate volume connection completed successfully. Jan 15 21:12:12.019654 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-223f25c0-ee9d-4240-a260-bf9c346f1c9f tempest-VolumesBackupsTest-197440665 None] Remove volume export completed successfully. Jan 15 21:12:12.641817 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:12.707809 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:13.536414 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] Volume volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:13.555630 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] deleting rbd volume volume-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:14.297372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] Created reservations ['116fb0b5-86bb-49ec-9826-5cbc61984811', 'c0131b07-e841-4c2e-8ba3-5bb7fe43ccc1', '9cfd5d8c-bde9-4ddc-bd12-fa65133e4c46', '3b35f97e-fd0e-4e38-b31d-87d7a4ed882f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:14.424871 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:14.523592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:14.561674 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:14.566337 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] Deleted volume successfully. Jan 15 21:12:14.593952 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4ef13632-f803-4dea-9772-40ba936c0134 tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-3b97ba69-58fd-4c51-a8ae-7ab354daf8ec-delete_volume'" released by "delete_volume" :: held 1.953s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:17.307526 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-730ab34e-1940-4999-811d-3fd7a179af20-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:17.386995 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:18.655033 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] deleting rbd volume volume-730ab34e-1940-4999-811d-3fd7a179af20 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:18.921731 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-6cc5a220-6f3e-44cc-a799-b1f62499c03d tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['ab5499d0-3cca-48ec-9843-756acea64a1a', '39899fc2-1a4f-4656-b4d4-11e9fc448140', '35eab763-6622-46c3-a00a-f7db1f7bcc23', '81fa0e0d-82c3-4b2f-8d9f-15af0116200d'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:19.013830 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:12:19.062113 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] deleting parent snapshot volume-730ab34e-1940-4999-811d-3fd7a179af20.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:12:19.701364 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6cc5a220-6f3e-44cc-a799-b1f62499c03d tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:12:19.726135 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-6cc5a220-6f3e-44cc-a799-b1f62499c03d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-8092b85d-4044-431d-93dc-ea37d2b24561-delete_snapshot'" released by "delete_snapshot" :: held 31.088s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:19.809981 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] Created reservations ['3085bd1d-262e-4159-90e4-eb15dafb31e6', 'e028c32a-66c3-4611-a3c1-73dfe7592df8', 'd34b58d1-07db-4fdc-a19d-7c0cdcfaa45b', 'f93f2012-70fc-4375-8f64-a3737ebb15b6'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:19.906947 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:20.005578 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:20.090314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:20.097309 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] Deleted volume successfully. Jan 15 21:12:20.125642 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-eea9952d-5431-4e14-8fad-53d4f35bd2d0 tempest-VolumesBackupsTest-197440665 None] Lock "b'cinder-730ab34e-1940-4999-811d-3fd7a179af20-delete_volume'" released by "delete_volume" :: held 2.819s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:21.254789 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 req-f0ba23a7-5b5b-401d-8508-4eccc7a07c97 tempest-VolumesSnapshotTestJSON-711254379 None] Terminate volume connection completed successfully. Jan 15 21:12:21.256768 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-de53118d-cce0-4ed3-bd05-5e9e48b584b1 req-f0ba23a7-5b5b-401d-8508-4eccc7a07c97 tempest-VolumesSnapshotTestJSON-711254379 None] Deleting attachment 5f29796d-d578-4aac-8093-f2c68ba18906. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:12:24.315901 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:24.319856 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:24.320369 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:24.347315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (c4abd9cf-c675-4515-b7cc-5f33554fc159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:24.368477 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c0f29f-97c6-4c0c-8705-431acbdf2268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:24.388280 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:24.412321 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c0f29f-97c6-4c0c-8705-431acbdf2268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1078085168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a41ee745-635b-4c29-8b44-451588f551bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b7e1186ac94edc96e86c4a3aea2f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:24Z,use_quota=True,user_id='6abbfe95b7af498481636b742b570560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:24.419482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c68ce63-ba61-47ed-8925-114ea433970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:24.424862 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c68ce63-ba61-47ed-8925-114ea433970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:24.430681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac536e5-d1c2-4f01-b8f1-abccadd9c1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:24.567848 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac536e5-d1c2-4f01-b8f1-abccadd9c1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a41ee745-635b-4c29-8b44-451588f551bb', 'volume_name': 'volume-a41ee745-635b-4c29-8b44-451588f551bb', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:24.573766 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061ae07a-ef37-4d96-9bf9-68be6848c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:24.589706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061ae07a-ef37-4d96-9bf9-68be6848c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:24.600609 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b8b292-b40c-4cfc-8219-03572180c5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:24.602137 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Volume a41ee745-635b-4c29-8b44-451588f551bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a41ee745-635b-4c29-8b44-451588f551bb', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:12:24.607352 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Cloning a41ee745-635b-4c29-8b44-451588f551bb from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:12:24.623074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:24.640165 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 12, 24, 629434)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:12:24.641058 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:12:24.641058 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:12:24.646904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:24.648189 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:12:24.660961 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 12, 24, 654053)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:12:24.661663 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:12:24.662212 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:12:24.683659 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:24.758428 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] creating snapshot='volume-a41ee745-635b-4c29-8b44-451588f551bb.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:12:25.589662 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-a41ee745-635b-4c29-8b44-451588f551bb.clone_snap' to 'volume-a41ee745-635b-4c29-8b44-451588f551bb' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:12:25.805528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:25.807916 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:25.809940 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:25.848890 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:12:25.849822 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Marking volume a41ee745-635b-4c29-8b44-451588f551bb as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:12:25.880710 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to a41ee745-635b-4c29-8b44-451588f551bb. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:12:25.881499 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Creating volume glance metadata for volume a41ee745-635b-4c29-8b44-451588f551bb backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:12:26.018899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b8b292-b40c-4cfc-8219-03572180c5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41ee745-635b-4c29-8b44-451588f551bb', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:26.027215 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d7a6a8-6835-4aa6-b63f-abf7932f4c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:26.042981 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Volume volume-a41ee745-635b-4c29-8b44-451588f551bb (a41ee745-635b-4c29-8b44-451588f551bb): created successfully Jan 15 21:12:26.058798 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d7a6a8-6835-4aa6-b63f-abf7932f4c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:26.074335 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (c4abd9cf-c675-4515-b7cc-5f33554fc159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:26.115480 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0d31c413-4cf5-4041-bbe2-a86deafcb31b tempest-VolumesCloneTest-627210303 None] Created volume successfully. Jan 15 21:12:27.397772 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:27.405291 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:27.406282 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:27.444938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (5f8fe6aa-a5ad-4bd3-b785-617a2d7f4115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:27.485746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87bb454-6e9e-4663-a0dd-ed18de6a0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.513369 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:27.543674 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:27.549119 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:27.553126 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:27.576326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87bb454-6e9e-4663-a0dd-ed18de6a0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1204804320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03d60542-8154-4953-b376-5fc371d12445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa736a1907e4790b2ea49bc7f31e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:27Z,use_quota=True,user_id='6d2364cc12914bd3922a66feb86c5c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.587022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dc459c-4e8c-4555-8146-9d8760c4647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.593746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dc459c-4e8c-4555-8146-9d8760c4647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.608358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e906c311-a8fe-4d34-b2b8-727ba8e19a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.618756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e906c311-a8fe-4d34-b2b8-727ba8e19a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d60542-8154-4953-b376-5fc371d12445', 'volume_name': 'volume-03d60542-8154-4953-b376-5fc371d12445', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.627428 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9066ca52-7293-4705-aaf3-d87e75414f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.634087 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9066ca52-7293-4705-aaf3-d87e75414f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.641574 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7f580e-6d3e-47e3-8e87-90e26d406984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.643010 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Volume 03d60542-8154-4953-b376-5fc371d12445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d60542-8154-4953-b376-5fc371d12445', 'volume_size': 1} Jan 15 21:12:27.643648 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] creating volume 'volume-03d60542-8154-4953-b376-5fc371d12445' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:12:27.646289 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:27.788265 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (e5f9aeec-dca0-4b6d-8c3f-c553cbc5cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:27.803626 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cd7720-bd97-4ebd-885b-18bef59705f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.813559 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:27.814310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:27.820984 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7f580e-6d3e-47e3-8e87-90e26d406984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d60542-8154-4953-b376-5fc371d12445', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.827168 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1eb45a-1f78-4fde-85d9-6e489ee5200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.838905 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:27.866486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cd7720-bd97-4ebd-885b-18bef59705f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2145075330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=21d20c5c-454d-43fa-bbc7-d9f9381f4808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b7e1186ac94edc96e86c4a3aea2f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a41ee745-635b-4c29-8b44-451588f551bb,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:27Z,use_quota=True,user_id='6abbfe95b7af498481636b742b570560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.874978 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d7801c-627e-40a4-903b-8acf16eca8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.882196 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d7801c-627e-40a4-903b-8acf16eca8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.902995 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941756cd-b85e-4d47-929e-dbb5efa65eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.927426 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941756cd-b85e-4d47-929e-dbb5efa65eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '21d20c5c-454d-43fa-bbc7-d9f9381f4808', 'volume_name': 'volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808', 'volume_size': 1, 'source_volid': 'a41ee745-635b-4c29-8b44-451588f551bb', 'source_volstatus': 'available'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.944491 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb943db-550e-4104-828a-c119835bdaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.952042 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb943db-550e-4104-828a-c119835bdaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.957763 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95722437-40fb-43b8-b744-40898370105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:27.959461 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Volume 21d20c5c-454d-43fa-bbc7-d9f9381f4808: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808', 'volume_size': 1, 'source_volid': 'a41ee745-635b-4c29-8b44-451588f551bb', 'source_volstatus': 'available'} Jan 15 21:12:27.964230 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-03d60542-8154-4953-b376-5fc371d12445 (03d60542-8154-4953-b376-5fc371d12445): created successfully Jan 15 21:12:27.983834 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1eb45a-1f78-4fde-85d9-6e489ee5200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:27.994825 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (5f8fe6aa-a5ad-4bd3-b785-617a2d7f4115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:28.026761 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:28.178581 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] creating snapshot='volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:12:28.403291 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] cloning 'volume-a41ee745-635b-4c29-8b44-451588f551bb@volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808.clone_snap' to 'volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:12:28.404795 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-66f2e40b-381d-4aa2-965e-92462bfe8a30 tempest-VolumesSnapshotTestJSON-711254379 None] Created volume successfully. Jan 15 21:12:28.640398 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c72f4759-5567-4723-981f-4f4ff39f6ac3 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:28.848303 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:28.851022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:28.851253 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:28.895032 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:12:28.895942 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Marking volume 21d20c5c-454d-43fa-bbc7-d9f9381f4808 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:12:28.912594 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Copying metadata from source volume a41ee745-635b-4c29-8b44-451588f551bb to 21d20c5c-454d-43fa-bbc7-d9f9381f4808. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Jan 15 21:12:28.984513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95722437-40fb-43b8-b744-40898370105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808', 'volume_size': 1, 'source_volid': 'a41ee745-635b-4c29-8b44-451588f551bb', 'source_volstatus': 'available'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:29.002097 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30b2c4b-2748-4857-8a29-730388c1b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:29.025518 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Volume volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808 (21d20c5c-454d-43fa-bbc7-d9f9381f4808): created successfully Jan 15 21:12:29.048435 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30b2c4b-2748-4857-8a29-730388c1b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:29.061436 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (e5f9aeec-dca0-4b6d-8c3f-c553cbc5cb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:29.094716 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e965fa83-7131-461e-9285-ad11e29889dd tempest-VolumesCloneTest-627210303 None] Created volume successfully. Jan 15 21:12:29.540471 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c72f4759-5567-4723-981f-4f4ff39f6ac3 tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:12:30.307386 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:30.325224 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:30.325831 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:30.410681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (a2aaecee-e6f6-43e0-8d26-c77b0c29f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:30.434616 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c98939f-7206-4fd2-812c-4972ac705cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:30.451035 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:30.477338 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c98939f-7206-4fd2-812c-4972ac705cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-40349196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81607208-bf88-435e-8bc5-e4937f4c13a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b7e1186ac94edc96e86c4a3aea2f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:30Z,use_quota=True,user_id='6abbfe95b7af498481636b742b570560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:30.493938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e674ddd7-62f6-4901-9014-8e23be3123f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:30.498286 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e674ddd7-62f6-4901-9014-8e23be3123f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:30.509130 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f815913-5d49-4094-9760-75beadac60f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:30.534479 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f815913-5d49-4094-9760-75beadac60f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81607208-bf88-435e-8bc5-e4937f4c13a3', 'volume_name': 'volume-81607208-bf88-435e-8bc5-e4937f4c13a3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:30.540963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e979fd-5596-40de-bb67-3f4533372308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:30.563986 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e979fd-5596-40de-bb67-3f4533372308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:30.576232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a28789-815e-498e-8efb-3e9710c1d4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:30.581448 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Volume 81607208-bf88-435e-8bc5-e4937f4c13a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81607208-bf88-435e-8bc5-e4937f4c13a3', 'volume_size': 1} Jan 15 21:12:30.594740 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] creating volume 'volume-81607208-bf88-435e-8bc5-e4937f4c13a3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:12:30.595484 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:30.766120 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:30.766531 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:30.772872 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a28789-815e-498e-8efb-3e9710c1d4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81607208-bf88-435e-8bc5-e4937f4c13a3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:30.785157 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03974c5-d37b-49cc-be63-632b418359b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:30.811143 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Volume volume-81607208-bf88-435e-8bc5-e4937f4c13a3 (81607208-bf88-435e-8bc5-e4937f4c13a3): created successfully Jan 15 21:12:30.816927 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03974c5-d37b-49cc-be63-632b418359b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:30.861444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (a2aaecee-e6f6-43e0-8d26-c77b0c29f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:30.886624 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-04f1e02c-a0d8-4f7a-bc76-dda4d458988a tempest-VolumesCloneTest-627210303 None] Created volume successfully. Jan 15 21:12:31.571559 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:31.580047 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:31.580741 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:31.640619 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (2eae98ae-2cab-4f74-85b2-a5a0165eeb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:31.652945 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919c4a66-af28-4663-b1e1-8cc88240f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:31.670178 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:31.710084 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919c4a66-af28-4663-b1e1-8cc88240f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1266727452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=67aedc1e-4f9f-4952-9f07-59e430d389b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa736a1907e4790b2ea49bc7f31e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4e90c80f-1866-47d6-a790-a3119cdcc9a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:31Z,use_quota=True,user_id='6d2364cc12914bd3922a66feb86c5c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:31.724656 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d0031-83a5-4358-aa1f-2d7f162cd2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:31.741067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d0031-83a5-4358-aa1f-2d7f162cd2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:31.755308 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73263756-e4fd-457c-8e48-f10b29076d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:31.775131 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73263756-e4fd-457c-8e48-f10b29076d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67aedc1e-4f9f-4952-9f07-59e430d389b5', 'volume_name': 'volume-67aedc1e-4f9f-4952-9f07-59e430d389b5', 'volume_size': 2, 'snapshot_id': '4e90c80f-1866-47d6-a790-a3119cdcc9a1'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:31.809407 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2580ee05-cea3-4e98-ae3d-fe8e123a5e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:31.830547 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2580ee05-cea3-4e98-ae3d-fe8e123a5e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:31.837646 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bdaa0f-4260-4c11-a94b-54afc6f47b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:31.839213 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Volume 67aedc1e-4f9f-4952-9f07-59e430d389b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67aedc1e-4f9f-4952-9f07-59e430d389b5', 'volume_size': 2, 'snapshot_id': '4e90c80f-1866-47d6-a790-a3119cdcc9a1'} Jan 15 21:12:31.890040 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] cloning volumes/volume-03d60542-8154-4953-b376-5fc371d12445@snapshot-4e90c80f-1866-47d6-a790-a3119cdcc9a1 to volume-67aedc1e-4f9f-4952-9f07-59e430d389b5 {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:12:31.908021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:32.042663 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:32.321207 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:32.321625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:32.327333 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:32.542382 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:32.547329 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:32.549055 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:32.624636 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (df7e0df8-29be-4db9-bea7-359c15c5718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:32.644992 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bcffe-ef79-4d08-aff4-380256509fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:32.673131 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:32.704497 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34bdaa0f-4260-4c11-a94b-54afc6f47b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67aedc1e-4f9f-4952-9f07-59e430d389b5', 'volume_size': 2, 'snapshot_id': '4e90c80f-1866-47d6-a790-a3119cdcc9a1'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:32.714902 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09c51cc-7e62-4b27-b043-d4cd8fec68f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:32.735908 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-67aedc1e-4f9f-4952-9f07-59e430d389b5 (67aedc1e-4f9f-4952-9f07-59e430d389b5): created successfully Jan 15 21:12:32.746421 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09c51cc-7e62-4b27-b043-d4cd8fec68f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:32.759454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (2eae98ae-2cab-4f74-85b2-a5a0165eeb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:32.796355 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bcffe-ef79-4d08-aff4-380256509fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-386390191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0d59d9f5-63f9-4f67-b8ab-8fb001cd8281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b7e1186ac94edc96e86c4a3aea2f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=81607208-bf88-435e-8bc5-e4937f4c13a3,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:32Z,use_quota=True,user_id='6abbfe95b7af498481636b742b570560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:32.814126 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f74a3e-df2b-4d91-b128-dbcb710cd78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:32.819747 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f74a3e-df2b-4d91-b128-dbcb710cd78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:32.829998 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be80016-9fbb-4a91-a71a-2f291829de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:32.884629 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be80016-9fbb-4a91-a71a-2f291829de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0d59d9f5-63f9-4f67-b8ab-8fb001cd8281', 'volume_name': 'volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281', 'volume_size': 2, 'source_volid': '81607208-bf88-435e-8bc5-e4937f4c13a3', 'source_volstatus': 'available'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:32.911417 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906218b0-369c-4caa-8011-cf74c300327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:32.929538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906218b0-369c-4caa-8011-cf74c300327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:32.952049 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd4923b-0dc8-4cd6-ba38-e1fcbbc6db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:32.962995 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Volume 0d59d9f5-63f9-4f67-b8ab-8fb001cd8281: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281', 'volume_size': 2, 'source_volid': '81607208-bf88-435e-8bc5-e4937f4c13a3', 'source_volstatus': 'available'} Jan 15 21:12:33.006451 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:33.145786 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] creating snapshot='volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:12:33.482628 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] cloning 'volume-81607208-bf88-435e-8bc5-e4937f4c13a3@volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281.clone_snap' to 'volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:12:33.491807 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8e54ef78-13df-4e7d-ab63-bc8e5031a1f4 tempest-VolumesSnapshotTestJSON-711254379 None] Created volume successfully. Jan 15 21:12:33.654204 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Volume volume-81607208-bf88-435e-8bc5-e4937f4c13a3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:33.655362 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:33.655732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:33.685338 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] resize volume 'volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281' from 1 to 2 {{(pid=122725) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:694}} Jan 15 21:12:33.685754 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:33.809613 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-67aedc1e-4f9f-4952-9f07-59e430d389b5-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:33.866785 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:33.972815 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:33.983136 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-67aedc1e-4f9f-4952-9f07-59e430d389b5 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:34.000751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:12:34.009642 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd4923b-0dc8-4cd6-ba38-e1fcbbc6db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281', 'volume_size': 2, 'source_volid': '81607208-bf88-435e-8bc5-e4937f4c13a3', 'source_volstatus': 'available'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:34.019394 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707273b2-3185-4a1f-97b0-ebbdb9968c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:34.033091 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Volume volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281 (0d59d9f5-63f9-4f67-b8ab-8fb001cd8281): created successfully Jan 15 21:12:34.039118 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707273b2-3185-4a1f-97b0-ebbdb9968c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:34.051815 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Flow 'volume_create_manager' (df7e0df8-29be-4db9-bea7-359c15c5718e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:34.079941 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-87b4b2ff-e9c4-43fa-9c13-c7c32921bf4e tempest-VolumesCloneTest-627210303 None] Created volume successfully. Jan 15 21:12:34.456556 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['59909d35-5ef7-4ff1-abd9-fdb5ca3618b5', '1e9ba570-34c5-40ee-9445-8c47a85940c5', 'b1eb1e4e-9d1b-4535-8ead-67d773140e03', '70c20d5d-03d5-4d12-bd8c-a6c99b0a35ed'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:34.541003 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:34.636359 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:34.708424 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:34.727956 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:12:34.747255 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-74bdb6b0-1ae0-452c-a28e-aef2b996e455 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-67aedc1e-4f9f-4952-9f07-59e430d389b5-delete_volume'" released by "delete_volume" :: held 0.936s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:34.766505 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281-delete_volume'" acquired by "delete_volume" :: waited 0.051s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:34.910313 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:35.046533 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:35.058188 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] deleting rbd volume volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:35.419396 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:12:35.443072 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] Volume volume-81607208-bf88-435e-8bc5-e4937f4c13a3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:35.444771 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] deleting parent snapshot volume-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:12:36.665483 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:36.674200 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:36.674650 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:36.709335 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (5aca96d1-0b98-4da5-9fb5-74730c8ea82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:36.726606 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a78967-1a86-463f-b35a-4b6e5cdbec66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:36.746593 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:36.803131 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a78967-1a86-463f-b35a-4b6e5cdbec66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1857637365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3da1131-759c-45bd-91f1-53272531a183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa736a1907e4790b2ea49bc7f31e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:36Z,use_quota=True,user_id='6d2364cc12914bd3922a66feb86c5c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:36.818067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2477d44-f8af-4278-af03-b80ebaa1a370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:36.831971 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2477d44-f8af-4278-af03-b80ebaa1a370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:36.843183 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f015c55-c7aa-4190-ba2d-d54b194595ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:36.848234 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f015c55-c7aa-4190-ba2d-d54b194595ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3da1131-759c-45bd-91f1-53272531a183', 'volume_name': 'volume-c3da1131-759c-45bd-91f1-53272531a183', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:36.863536 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa4fe2d-e3f3-454a-88b6-7d03f4ed6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:36.874835 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa4fe2d-e3f3-454a-88b6-7d03f4ed6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:36.880264 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d5e7aa-8f38-4f34-9bb6-b050d15a17a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:36.882032 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Volume c3da1131-759c-45bd-91f1-53272531a183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3da1131-759c-45bd-91f1-53272531a183', 'volume_size': 1} Jan 15 21:12:36.882426 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] creating volume 'volume-c3da1131-759c-45bd-91f1-53272531a183' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:12:36.884697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:36.980103 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] Created reservations ['9bf77e6a-7d13-42cc-8b0f-e3fcedfb9715', '37b7f302-afc0-449f-9f31-8bebd68ba1eb', '4578c6e8-4f0c-436a-b172-4a96ad15f3ec', 'f7993b1e-6fa7-4856-b646-dab324538aa8'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:37.006581 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:37.007108 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:37.014783 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d5e7aa-8f38-4f34-9bb6-b050d15a17a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3da1131-759c-45bd-91f1-53272531a183', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:37.021483 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42643a9f-d033-49ba-a545-9170e4d50043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:37.069801 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-c3da1131-759c-45bd-91f1-53272531a183 (c3da1131-759c-45bd-91f1-53272531a183): created successfully Jan 15 21:12:37.076187 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42643a9f-d033-49ba-a545-9170e4d50043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:37.085710 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (5aca96d1-0b98-4da5-9fb5-74730c8ea82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:37.093968 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:37.161126 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:37.237015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:37.241280 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-45bc4272-e08d-4f2e-8860-2e652d1734f6 tempest-VolumesSnapshotTestJSON-711254379 None] Created volume successfully. Jan 15 21:12:37.244733 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] Deleted volume successfully. Jan 15 21:12:37.275394 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8736f5e0-ec5c-4266-9851-6da0faa1d3a7 tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-0d59d9f5-63f9-4f67-b8ab-8fb001cd8281-delete_volume'" released by "delete_volume" :: held 2.508s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:38.204232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-81607208-bf88-435e-8bc5-e4937f4c13a3-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:38.292143 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:38.381197 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:38.381875 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] Volume volume-81607208-bf88-435e-8bc5-e4937f4c13a3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:38.394693 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] deleting rbd volume volume-81607208-bf88-435e-8bc5-e4937f4c13a3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:38.495428 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-14a28fe9-eb25-40e2-a435-71b107088bf1 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:38.875558 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-14a28fe9-eb25-40e2-a435-71b107088bf1 tempest-VolumesSnapshotTestJSON-711254379 None] Create snapshot completed successfully Jan 15 21:12:38.882499 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] Created reservations ['f5107f60-aa22-4fd8-93db-0f76f2d259db', 'bd992b19-fac3-4fd3-97e8-657f3e8e4ddc', '83fa7130-b697-402c-a8b0-404d87a64d77', '063d7d0e-c78e-4c01-aebc-a1ecfe6f2ed5'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:38.950902 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:39.033158 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:39.101057 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:39.111646 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] Deleted volume successfully. Jan 15 21:12:39.140307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1ef2c44c-af96-45d0-8238-3b04d70bfe3d tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-81607208-bf88-435e-8bc5-e4937f4c13a3-delete_volume'" released by "delete_volume" :: held 0.935s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:39.480485 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-21d20c5c-454d-43fa-bbc7-d9f9381f4808-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:39.604453 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:39.761473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:39.775896 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] deleting rbd volume volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:40.175245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:12:40.229668 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] deleting parent snapshot volume-21d20c5c-454d-43fa-bbc7-d9f9381f4808.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:12:40.903077 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:12:40.915437 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:12:40.916189 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:12:40.994270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (a073a55e-d462-4817-b47b-de40a5f0b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:41.001223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676ad569-0d36-46c9-973d-d861b188c174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:41.004397 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:12:41.025280 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676ad569-0d36-46c9-973d-d861b188c174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1966341994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31511785-fbfd-47b6-8e1a-1fdde38c1403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aa736a1907e4790b2ea49bc7f31e50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b0af654-8eb4-4006-8f66-26f0b7dab34b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:12:40Z,use_quota=True,user_id='6d2364cc12914bd3922a66feb86c5c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:41.031016 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92d472a-beb2-4d1b-9935-06e4d7224e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:41.035518 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92d472a-beb2-4d1b-9935-06e4d7224e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:41.044731 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf9a9b2-5715-4a49-9a00-b9c31a867992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:41.050397 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf9a9b2-5715-4a49-9a00-b9c31a867992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31511785-fbfd-47b6-8e1a-1fdde38c1403', 'volume_name': 'volume-31511785-fbfd-47b6-8e1a-1fdde38c1403', 'volume_size': 1, 'snapshot_id': '7b0af654-8eb4-4006-8f66-26f0b7dab34b'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:41.060243 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf7113f-e8ef-4df9-b220-f6b9bd6f40fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:41.068880 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf7113f-e8ef-4df9-b220-f6b9bd6f40fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:41.074644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabd8237-3690-4e26-a77a-7d6b6d25f95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:41.077045 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Volume 31511785-fbfd-47b6-8e1a-1fdde38c1403: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31511785-fbfd-47b6-8e1a-1fdde38c1403', 'volume_size': 1, 'snapshot_id': '7b0af654-8eb4-4006-8f66-26f0b7dab34b'} Jan 15 21:12:41.115088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] cloning volumes/volume-c3da1131-759c-45bd-91f1-53272531a183@snapshot-7b0af654-8eb4-4006-8f66-26f0b7dab34b to volume-31511785-fbfd-47b6-8e1a-1fdde38c1403 {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:12:41.116083 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:41.214226 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:41.279849 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] Created reservations ['5ec79a51-b44e-4fca-946f-c045109f3aa6', 'fc930f11-7ef2-429e-849b-dd3fb58249c6', '955310f5-ef09-495b-b371-4ccfc5f1d1d7', '3908dad8-1324-454d-bb6a-d6d3d78c3f9e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:41.312560 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:12:41.313450 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:41.396695 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:41.464498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:41.473707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:12:41.473707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:12:41.508857 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabd8237-3690-4e26-a77a-7d6b6d25f95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31511785-fbfd-47b6-8e1a-1fdde38c1403', 'volume_size': 1, 'snapshot_id': '7b0af654-8eb4-4006-8f66-26f0b7dab34b'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:41.513725 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b70df3-0f63-4669-a555-65a5749bee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:12:41.527662 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-31511785-fbfd-47b6-8e1a-1fdde38c1403 (31511785-fbfd-47b6-8e1a-1fdde38c1403): created successfully Jan 15 21:12:41.531817 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b70df3-0f63-4669-a555-65a5749bee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:12:41.537951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Flow 'volume_create_manager' (a073a55e-d462-4817-b47b-de40a5f0b324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:12:41.572613 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a2824db4-da16-4232-a6e0-67056b8e0c8b tempest-VolumesSnapshotTestJSON-711254379 None] Created volume successfully. Jan 15 21:12:41.584251 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:41.631766 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:41.708018 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:41.720780 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] Deleted volume successfully. Jan 15 21:12:41.751428 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-63fc0e6f-aa44-4ee5-873a-814040ccf942 tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-21d20c5c-454d-43fa-bbc7-d9f9381f4808-delete_volume'" released by "delete_volume" :: held 2.273s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:41.871051 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-a41ee745-635b-4c29-8b44-451588f551bb-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:41.997256 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:42.139572 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:42.153033 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] deleting rbd volume volume-a41ee745-635b-4c29-8b44-451588f551bb {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:42.601047 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:12:42.644291 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] deleting parent snapshot volume-a41ee745-635b-4c29-8b44-451588f551bb.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:12:42.934116 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-31511785-fbfd-47b6-8e1a-1fdde38c1403-delete_volume'" acquired by "delete_volume" :: waited 0.052s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:43.014549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] Created reservations ['9e56b942-a468-40a2-9b1b-4f6cf0609e7a', 'e0517d1e-8823-4bef-b018-23f86b4c0fe1', 'd6566efb-bddd-433a-b22b-a4da13c5bdd2', 'ff838c94-ad14-4ead-b937-fd4a07d1f26e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:43.091064 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:43.208580 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:43.220823 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-31511785-fbfd-47b6-8e1a-1fdde38c1403 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:43.280068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:43.389790 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:43.473506 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:43.484442 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] Deleted volume successfully. Jan 15 21:12:43.509308 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c3bc52c7-9974-4180-9dce-f130251cf57a tempest-VolumesCloneTest-627210303 None] Lock "b'cinder-a41ee745-635b-4c29-8b44-451588f551bb-delete_volume'" released by "delete_volume" :: held 1.637s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:43.663732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['ab0d058e-f8fe-4e9d-a292-368be1947e3f', '9ab67e66-b6ee-4783-be52-7b1628b4a1fa', '94d1aa45-fea7-4cb7-8fc0-8588d64a6bf2', '5bdba111-bec6-4b43-a681-7ec4d61539bb'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:43.716923 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:43.781843 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:43.832854 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:43.843031 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:12:43.860120 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-374b59f2-617d-4c6e-87f6-c0eb5687df12 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-31511785-fbfd-47b6-8e1a-1fdde38c1403-delete_volume'" released by "delete_volume" :: held 0.926s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:44.163411 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1d531c21-ce97-44ea-b1cb-0d4ed75ae82d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-7b0af654-8eb4-4006-8f66-26f0b7dab34b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:44.170398 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1d531c21-ce97-44ea-b1cb-0d4ed75ae82d tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:44.663200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1d531c21-ce97-44ea-b1cb-0d4ed75ae82d tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['f83b318a-d60a-431a-bb6c-d57a0119eb87', '42f28298-05c3-4caa-823a-5773b48e9e95', 'dd1d43c4-73a9-4449-b102-ed9be38cc7c3', 'c1f4fa0a-538c-46d9-a39a-21bc82166eab'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:44.733191 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1d531c21-ce97-44ea-b1cb-0d4ed75ae82d tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:12:44.744912 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1d531c21-ce97-44ea-b1cb-0d4ed75ae82d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-7b0af654-8eb4-4006-8f66-26f0b7dab34b-delete_snapshot'" released by "delete_snapshot" :: held 0.580s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:45.394025 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-c3da1131-759c-45bd-91f1-53272531a183-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:45.480476 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:45.618829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:45.619041 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-c3da1131-759c-45bd-91f1-53272531a183 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:45.631470 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-c3da1131-759c-45bd-91f1-53272531a183 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:46.119454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['4af3c11b-d59a-4080-8757-b2ee61447996', 'cc11457a-aa17-408a-b0ba-37093502855b', 'aab5eb60-bbf2-4563-83a5-69e1ab06a6ac', 'c99cad3f-d04d-4958-90ec-5926a8de2da3'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:46.233304 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:46.317374 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:46.393259 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:46.398282 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:12:46.418656 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-20c6f010-8dbc-4eca-9349-62428320d3f7 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-c3da1131-759c-45bd-91f1-53272531a183-delete_volume'" released by "delete_volume" :: held 1.025s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:46.673544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-53578113-846d-4ee6-9ed5-a5ca3d1320f7 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-4e90c80f-1866-47d6-a790-a3119cdcc9a1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:46.680307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-53578113-846d-4ee6-9ed5-a5ca3d1320f7 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:48.063020 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-53578113-846d-4ee6-9ed5-a5ca3d1320f7 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['67741bd6-e259-4f71-9361-58f000675ee7', '3d1b2a56-8b73-4d85-8785-aea541626fc4', '7ebc984f-724a-4a77-89f1-6ea1db341085', '648eb41e-d2b4-4c08-8739-8b983f37345f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:48.150850 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-53578113-846d-4ee6-9ed5-a5ca3d1320f7 tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:12:48.156596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-53578113-846d-4ee6-9ed5-a5ca3d1320f7 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-4e90c80f-1866-47d6-a790-a3119cdcc9a1-delete_snapshot'" released by "delete_snapshot" :: held 1.489s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:48.974631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-03d60542-8154-4953-b376-5fc371d12445-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:49.038534 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:49.156764 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:49.157517 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-03d60542-8154-4953-b376-5fc371d12445 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:49.170232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-03d60542-8154-4953-b376-5fc371d12445 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:49.576386 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['34140b1e-14ec-4d16-9c45-8a448bc08e46', '813bfa4b-d2db-444b-aeab-16ecb85e90ff', '981bcc5e-8c9c-46cc-bf7d-985b173e6ff9', 'e26cfbc0-826c-44c2-9a6d-103475d7d216'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:49.721940 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:49.792934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:49.851926 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:49.864463 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:12:49.897319 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1f2da4b3-68e6-4318-8615-1084dc92c62d tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-03d60542-8154-4953-b376-5fc371d12445-delete_volume'" released by "delete_volume" :: held 0.924s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:50.454623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:50.556618 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:50.673448 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:50.683372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:51.027238 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:12:51.071478 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] deleting parent snapshot volume-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:12:51.279924 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['693c224a-f8d0-440a-81bd-f2a948f1fd25', 'f36aab96-d4a3-4385-82c6-ef6dabcbda88', '3f6cf7b7-9edb-4dbd-86a8-c77f90d184bf', '24105c02-03b6-4ce3-bb49-e7fcc9fd6e00'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:51.365663 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:51.446816 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:51.486537 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:51.496039 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:12:51.517196 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a6c5ee13-d883-490a-84fa-2054e3f0a542 tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-1df1f210-c337-4c2c-9ab2-6ce7c8ff1134-delete_volume'" released by "delete_volume" :: held 1.062s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:51.621662 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2a353522-97c6-416e-8f79-203e2660591f tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-83fca79f-1c91-4238-a0ac-c224626f75a2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:51.625438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2a353522-97c6-416e-8f79-203e2660591f tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:52.345595 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2a353522-97c6-416e-8f79-203e2660591f tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['a3fcbb15-fd2a-4295-acf3-0beb53dd0fad', '8f7b44bf-0933-4df9-a54b-15bc24c78aa9', '3319a817-f08e-42b6-a3fd-87a09c4c9b18', '14dd9d4c-c314-4abb-906d-30a5e830a158'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:52.405322 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2a353522-97c6-416e-8f79-203e2660591f tempest-VolumesSnapshotTestJSON-711254379 None] Delete snapshot completed successfully. Jan 15 21:12:52.411183 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2a353522-97c6-416e-8f79-203e2660591f tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-83fca79f-1c91-4238-a0ac-c224626f75a2-delete_snapshot'" released by "delete_snapshot" :: held 0.790s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:12:52.779659 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-54e36e7f-6e75-428b-97f3-c673d414e0e9-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:12:52.883433 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:52.967398 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:12:52.967938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] Volume volume-54e36e7f-6e75-428b-97f3-c673d414e0e9 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:12:52.983401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] deleting rbd volume volume-54e36e7f-6e75-428b-97f3-c673d414e0e9 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:12:53.428043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] Created reservations ['0eda1b88-ccbf-40c8-9bad-1c281e696b55', '74a50791-dd92-42f1-83b7-aa83477144d9', '9c794991-a295-4465-a057-7747ef5f1a5c', 'e9d989b1-2f35-4d77-bf0a-8d1357808d5d'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:12:53.555124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:53.634096 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:12:53.707733 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:12:53.714203 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] Deleted volume successfully. Jan 15 21:12:53.762000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-1e7bd670-034c-44ce-bade-2be8cee5e5be tempest-VolumesSnapshotTestJSON-711254379 None] Lock "b'cinder-54e36e7f-6e75-428b-97f3-c673d414e0e9-delete_volume'" released by "delete_volume" :: held 0.982s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:02.541111 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:13:02.557608 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:13:02.559909 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:13:02.649342 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Flow 'volume_create_manager' (e4ff7197-92fb-4a72-9202-c65c7905c952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:13:02.677300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdee109b-938e-445f-b720-7d9aaf43fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:02.729305 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:13:02.778763 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdee109b-938e-445f-b720-7d9aaf43fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-202414038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b9dd89a-47e3-44c2-9aba-4d077fe1c641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbe70fd87994e9a92d0f688afd042ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:13:02Z,use_quota=True,user_id='7a4bd439dae44c4db300bdcf2523df92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:02.788250 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e775b4a4-f9cf-4efd-89ba-b2611eae5933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:02.818763 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e775b4a4-f9cf-4efd-89ba-b2611eae5933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:02.832383 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2761d48e-2bf0-4aa7-bc02-4a4d672fe21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:02.851737 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2761d48e-2bf0-4aa7-bc02-4a4d672fe21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9dd89a-47e3-44c2-9aba-4d077fe1c641', 'volume_name': 'volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:02.865596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892641af-a723-4136-a8b3-fcc19b58a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:02.893252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892641af-a723-4136-a8b3-fcc19b58a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:02.899419 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad828792-ce6a-4b9b-a095-3901328c6c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:02.900874 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Volume 0b9dd89a-47e3-44c2-9aba-4d077fe1c641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641', 'volume_size': 1} Jan 15 21:13:02.901484 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] creating volume 'volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:13:02.902714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:03.044522 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:13:03.045246 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:13:03.049934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad828792-ce6a-4b9b-a095-3901328c6c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:03.062084 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174046a6-fbf3-42fc-a6b3-439320ccde20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:03.080146 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Volume volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641 (0b9dd89a-47e3-44c2-9aba-4d077fe1c641): created successfully Jan 15 21:13:03.088689 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174046a6-fbf3-42fc-a6b3-439320ccde20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:03.098825 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Flow 'volume_create_manager' (e4ff7197-92fb-4a72-9202-c65c7905c952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:13:03.119726 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c58a6127-228d-404b-86e7-47ca8c72d9c6 tempest-VolumesSnapshotListTestJSON-1135063851 None] Created volume successfully. Jan 15 21:13:03.782560 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-da7bfa65-0e01-49a4-b058-91b09d76f048 tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:04.442427 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-da7bfa65-0e01-49a4-b058-91b09d76f048 tempest-VolumesSnapshotListTestJSON-1135063851 None] Create snapshot completed successfully Jan 15 21:13:05.102232 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1f316035-3b77-412c-ad41-4ca0354401fd tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:05.652746 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1f316035-3b77-412c-ad41-4ca0354401fd tempest-VolumesSnapshotListTestJSON-1135063851 None] Create snapshot completed successfully Jan 15 21:13:06.459355 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b60968f0-e04b-4c5d-adec-8dca05be7022 tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:07.524472 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b60968f0-e04b-4c5d-adec-8dca05be7022 tempest-VolumesSnapshotListTestJSON-1135063851 None] Create snapshot completed successfully Jan 15 21:13:09.856462 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3241948e-f32f-4412-97c4-dbf2edfeaaca tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-8aa5c6eb-6456-41d1-b6f7-760c75e0b46c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:13:09.857910 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3241948e-f32f-4412-97c4-dbf2edfeaaca tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:10.712774 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-3241948e-f32f-4412-97c4-dbf2edfeaaca tempest-VolumesSnapshotListTestJSON-1135063851 None] Created reservations ['79cf7543-3e13-42e5-b333-d1667f057563', '266568fb-0d56-4767-952a-8e435dc49eb3', 'b5fbe476-1891-430d-82fb-a099c23cf31d', 'f8b6401b-c1f8-416a-ba24-fa069f0de583'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:13:10.786546 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3241948e-f32f-4412-97c4-dbf2edfeaaca tempest-VolumesSnapshotListTestJSON-1135063851 None] Delete snapshot completed successfully. Jan 15 21:13:10.792500 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3241948e-f32f-4412-97c4-dbf2edfeaaca tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-8aa5c6eb-6456-41d1-b6f7-760c75e0b46c-delete_snapshot'" released by "delete_snapshot" :: held 0.936s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:11.052562 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2c660adf-96b9-42f9-9620-29db0341969f tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-c6d97018-345e-430d-8dfc-a789ec751154-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:13:11.056490 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c660adf-96b9-42f9-9620-29db0341969f tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:11.757796 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2c660adf-96b9-42f9-9620-29db0341969f tempest-VolumesSnapshotListTestJSON-1135063851 None] Created reservations ['188ea6b8-716c-43bf-aeee-80609c052e66', 'c43f6f8d-8b3d-42e2-8e2b-cfcb70ab0c54', '53551b60-78de-4259-921e-773b8915b743', '51281965-2d8e-4f20-9386-2fe0c194b18e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:13:11.835950 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2c660adf-96b9-42f9-9620-29db0341969f tempest-VolumesSnapshotListTestJSON-1135063851 None] Delete snapshot completed successfully. Jan 15 21:13:11.842962 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2c660adf-96b9-42f9-9620-29db0341969f tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-c6d97018-345e-430d-8dfc-a789ec751154-delete_snapshot'" released by "delete_snapshot" :: held 0.790s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:12.201326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7a3cf0bd-874e-4bff-acf9-f0520fca2c0e tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-425ea87d-2e0a-4b24-bf08-be02794d32c8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.041s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:13:12.203721 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7a3cf0bd-874e-4bff-acf9-f0520fca2c0e tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:12.680214 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-7a3cf0bd-874e-4bff-acf9-f0520fca2c0e tempest-VolumesSnapshotListTestJSON-1135063851 None] Created reservations ['9293b2d7-faf3-43b4-a6a9-31b2b4c93d23', '92fa727a-d258-4b96-b7e8-3211ef30b1a3', 'f3876bc1-3169-4779-9fde-8a353dd8c646', '344cb71a-cd7e-4425-8f9e-b20ac527923e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:13:12.764898 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7a3cf0bd-874e-4bff-acf9-f0520fca2c0e tempest-VolumesSnapshotListTestJSON-1135063851 None] Delete snapshot completed successfully. Jan 15 21:13:12.773915 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7a3cf0bd-874e-4bff-acf9-f0520fca2c0e tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-425ea87d-2e0a-4b24-bf08-be02794d32c8-delete_snapshot'" released by "delete_snapshot" :: held 0.573s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:13.309209 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-0b9dd89a-47e3-44c2-9aba-4d077fe1c641-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:13:13.388559 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:13.509882 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:13:13.510689 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] Volume volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:13:13.531194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] deleting rbd volume volume-0b9dd89a-47e3-44c2-9aba-4d077fe1c641 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:13:14.005708 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] Created reservations ['a15c26e0-7086-4770-b48c-c34e44c5f832', '772874e4-5665-40c7-b8c1-ab565aa1efb6', 'a6930c89-67f9-4379-9a93-c7204f81937c', '5c467ef2-b417-4341-be45-6a1359481c6c'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:13:14.109907 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:14.179223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:14.236210 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:13:14.242563 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] Deleted volume successfully. Jan 15 21:13:14.261200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-dfcaaa74-540b-43ad-b1af-9d2901c08d29 tempest-VolumesSnapshotListTestJSON-1135063851 None] Lock "b'cinder-0b9dd89a-47e3-44c2-9aba-4d077fe1c641-delete_volume'" released by "delete_volume" :: held 0.956s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:17.586266 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:13:17.592754 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:13:17.593559 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:13:17.667035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Flow 'volume_create_manager' (60f14817-cfd4-4d78-a5e3-30cbdafe8aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:13:17.704604 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8009e28f-6735-4691-8369-c4c417d5bef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:17.714341 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:13:17.752198 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8009e28f-6735-4691-8369-c4c417d5bef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-373178608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9e2a115b-16ae-48d5-bf1e-d0e5e40477a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de79ffc0278746b89c54a4261fa91576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:13:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:13:18Z,use_quota=True,user_id='43ee751e867e4eed8695d3cc95e080be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:17.776577 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3218d4-fa66-45f3-b51a-d412dca56d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:17.791354 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3218d4-fa66-45f3-b51a-d412dca56d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:17.803082 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b1ab62-031d-472a-99fb-da87ee435741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:17.812585 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b1ab62-031d-472a-99fb-da87ee435741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2a115b-16ae-48d5-bf1e-d0e5e40477a8', 'volume_name': 'volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8', 'volume_size': 2}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:17.824017 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22210ab-e27b-4b6e-974d-60d5d3c9ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:17.840307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22210ab-e27b-4b6e-974d-60d5d3c9ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:17.850914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d43dfa-cafc-44ae-bee5-f902f05fc4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:17.852504 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Volume 9e2a115b-16ae-48d5-bf1e-d0e5e40477a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8', 'volume_size': 2} Jan 15 21:13:17.853103 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] creating volume 'volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:13:17.854287 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:17.979382 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:13:17.979767 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:13:17.984580 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d43dfa-cafc-44ae-bee5-f902f05fc4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8', 'volume_size': 2}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:18.005339 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3d9c45-791b-4f8c-aac2-917587f66e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:13:18.031117 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Volume volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8 (9e2a115b-16ae-48d5-bf1e-d0e5e40477a8): created successfully Jan 15 21:13:18.037951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3d9c45-791b-4f8c-aac2-917587f66e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:13:18.049295 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Flow 'volume_create_manager' (60f14817-cfd4-4d78-a5e3-30cbdafe8aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:13:18.063502 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-bafefe70-1f3d-4125-82f0-7dfdc55fd422 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Created volume successfully. Jan 15 21:13:18.827437 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-924d9fcd-bdd4-4e3d-8a6d-d17416aebf63 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:19.426770 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-924d9fcd-bdd4-4e3d-8a6d-d17416aebf63 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Create snapshot completed successfully Jan 15 21:13:20.121698 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0db2d8b6-b741-45b1-930a-bf066f2b53b3 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Lock "b'cinder-6c2a8cd0-49ee-4937-b6b9-a6b99320c473-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:13:20.127105 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0db2d8b6-b741-45b1-930a-bf066f2b53b3 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:21.390078 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-0db2d8b6-b741-45b1-930a-bf066f2b53b3 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Created reservations ['b4f4d895-a3b8-4444-aac8-94936f71e5ff', '1381728f-fe79-48c0-8615-60391d65258d', '58808641-74d4-4720-abfe-f35d0970ec67', '99aebcf9-3515-4d6f-9713-d94ddcf68c0e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:13:21.425954 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0db2d8b6-b741-45b1-930a-bf066f2b53b3 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Delete snapshot completed successfully. Jan 15 21:13:21.434405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0db2d8b6-b741-45b1-930a-bf066f2b53b3 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Lock "b'cinder-6c2a8cd0-49ee-4937-b6b9-a6b99320c473-delete_snapshot'" released by "delete_snapshot" :: held 1.312s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:22.346576 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Lock "b'cinder-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:13:22.409782 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:22.492538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:13:22.492941 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Volume volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:13:22.501415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] deleting rbd volume volume-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:13:22.826703 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Created reservations ['d3285647-2147-4566-b8cf-b2a9953f0dd8', '80adaeea-ce47-4788-ac25-1046f509a0f0', '65b6f948-0662-479a-8493-dcaceb817bcb', '2d1840a0-242d-4a7d-bbb8-b90c0bf90132'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:13:22.898315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:22.942486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:22.971592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:13:22.975945 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Deleted volume successfully. Jan 15 21:13:22.990681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a9cb3042-ba00-4e21-8dfe-8e0636964429 tempest-VolumesSnapshotNegativeTestJSON-46095199 None] Lock "b'cinder-9e2a115b-16ae-48d5-bf1e-d0e5e40477a8-delete_volume'" released by "delete_volume" :: held 0.644s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:13:41.320203 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:13:41.320859 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:41.405931 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:13:41.477440 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:14:26.354241 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:14:26.403008 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:14:26.403008 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:14:26.457080 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Flow 'volume_create_manager' (e45150cd-e1b6-46f5-9bed-5ac4186f2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:14:26.467488 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8005955-6f69-47a3-97c7-336ade581c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:26.475211 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:14:26.499758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8005955-6f69-47a3-97c7-336ade581c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2147238153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=304a8d50-c297-4024-a907-a1bd0aed3922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f293bb4f2d84755a7fd006995ae5f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:14:26Z,use_quota=True,user_id='b618c4cabb8e47c49e10f659fd1e1490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:26.508784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e31371-ba34-458d-abe5-ee6ff4dbf91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:26.514644 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e31371-ba34-458d-abe5-ee6ff4dbf91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:26.520957 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d667fc5-f29f-4c4a-b85e-fe648fa2b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:26.526176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d667fc5-f29f-4c4a-b85e-fe648fa2b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304a8d50-c297-4024-a907-a1bd0aed3922', 'volume_name': 'volume-304a8d50-c297-4024-a907-a1bd0aed3922', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:26.533354 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bb5b73-250d-44da-91d4-39460037f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:26.538555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bb5b73-250d-44da-91d4-39460037f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:26.544601 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2844cd-37d6-484a-8d3f-d8c2e1598f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:26.546180 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Volume 304a8d50-c297-4024-a907-a1bd0aed3922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304a8d50-c297-4024-a907-a1bd0aed3922', 'volume_size': 1} Jan 15 21:14:26.546803 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] creating volume 'volume-304a8d50-c297-4024-a907-a1bd0aed3922' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:14:26.550201 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:14:26.631756 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:14:26.632125 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:14:26.636378 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2844cd-37d6-484a-8d3f-d8c2e1598f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304a8d50-c297-4024-a907-a1bd0aed3922', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:26.646329 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55428c7e-8429-424c-8b41-0bd3158fab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:26.658947 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Volume volume-304a8d50-c297-4024-a907-a1bd0aed3922 (304a8d50-c297-4024-a907-a1bd0aed3922): created successfully Jan 15 21:14:26.664465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55428c7e-8429-424c-8b41-0bd3158fab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:26.682364 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Flow 'volume_create_manager' (e45150cd-e1b6-46f5-9bed-5ac4186f2b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:14:26.696525 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1e6d0df8-1b16-40d5-9da1-fc136f52bf50 tempest-ServersNegativeTestJSON-1331787346 None] Created volume successfully. Jan 15 21:14:28.783744 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:14:28.790075 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:14:28.795244 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:14:28.817951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Flow 'volume_create_manager' (2bf9fd78-fecc-49c2-a219-307669e1d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:14:28.825881 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48738e1e-58a0-4e95-9a51-4a56a4445746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:28.833487 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:14:28.859687 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48738e1e-58a0-4e95-9a51-4a56a4445746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-53242323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=856107bf-7053-4ece-a849-e0b2c800dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f293bb4f2d84755a7fd006995ae5f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:14:29Z,use_quota=True,user_id='b618c4cabb8e47c49e10f659fd1e1490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:28.865904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f64e6e3-455a-4725-87a3-2de1a5115bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:28.870480 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f64e6e3-455a-4725-87a3-2de1a5115bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:28.875674 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e25a4c-6a83-4dbd-8e2a-ff9354d42b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:28.880655 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e25a4c-6a83-4dbd-8e2a-ff9354d42b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856107bf-7053-4ece-a849-e0b2c800dc88', 'volume_name': 'volume-856107bf-7053-4ece-a849-e0b2c800dc88', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:28.890405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae291e7-8aff-4b6d-bded-81d00d696369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:28.895702 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae291e7-8aff-4b6d-bded-81d00d696369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:28.901585 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da183003-b954-4a01-871a-de0df1948f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:28.903616 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Volume 856107bf-7053-4ece-a849-e0b2c800dc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856107bf-7053-4ece-a849-e0b2c800dc88', 'volume_size': 1} Jan 15 21:14:28.904013 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] creating volume 'volume-856107bf-7053-4ece-a849-e0b2c800dc88' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:14:28.906371 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:14:29.045803 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:14:29.046223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:14:29.051699 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da183003-b954-4a01-871a-de0df1948f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856107bf-7053-4ece-a849-e0b2c800dc88', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:29.062246 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a41f3c-cdf9-4e5d-b6f8-6b9a68a6b631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:14:29.074072 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Volume volume-856107bf-7053-4ece-a849-e0b2c800dc88 (856107bf-7053-4ece-a849-e0b2c800dc88): created successfully Jan 15 21:14:29.080738 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a41f3c-cdf9-4e5d-b6f8-6b9a68a6b631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:14:29.087575 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Flow 'volume_create_manager' (2bf9fd78-fecc-49c2-a219-307669e1d849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:14:29.098461 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7b2b6930-c287-4fd2-b1d0-e365fb926e2e tempest-ServersNegativeTestJSON-1331787346 None] Created volume successfully. Jan 15 21:14:41.323093 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:14:41.323972 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:14:41.384021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:14:41.477950 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:15:41.325642 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:15:41.326997 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:41.386985 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:41.433128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:15:44.532730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:15:44.543846 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:15:44.548359 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:15:44.578154 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Flow 'volume_create_manager' (e5ed880c-d2f4-4de5-93a3-1811782a9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:15:44.586504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f2d34e-8dd6-41e6-81f1-f9c8c4440fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:44.595230 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:15:44.624941 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f2d34e-8dd6-41e6-81f1-f9c8c4440fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1872221914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fee79ea4-666d-46ac-b249-f726739fc96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa822dbc25964946a789d1f43eb3c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:15:44Z,use_quota=True,user_id='4e4a4e8d5fcf4d2295d04c9244e05721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:44.642391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e13330-b7be-4a64-9d18-30a18ed2159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:44.647254 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e13330-b7be-4a64-9d18-30a18ed2159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:44.664284 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b42fa25-c618-4acf-8853-f8e41109fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:44.670934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b42fa25-c618-4acf-8853-f8e41109fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee79ea4-666d-46ac-b249-f726739fc96a', 'volume_name': 'volume-fee79ea4-666d-46ac-b249-f726739fc96a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:44.685002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c08e3-2e19-4469-8ba3-9f81e33a3a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:44.693017 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81c08e3-2e19-4469-8ba3-9f81e33a3a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:44.709285 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb166a8-36f4-4f38-a156-e6eaaef1415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:44.709853 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume fee79ea4-666d-46ac-b249-f726739fc96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee79ea4-666d-46ac-b249-f726739fc96a', 'volume_size': 1} Jan 15 21:15:44.710390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] creating volume 'volume-fee79ea4-666d-46ac-b249-f726739fc96a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:15:44.711231 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:44.883929 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:15:44.884314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:15:44.888182 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb166a8-36f4-4f38-a156-e6eaaef1415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee79ea4-666d-46ac-b249-f726739fc96a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:44.893609 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b308d9c8-9759-4be8-9745-bad0b9d5a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:44.925191 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume volume-fee79ea4-666d-46ac-b249-f726739fc96a (fee79ea4-666d-46ac-b249-f726739fc96a): created successfully Jan 15 21:15:44.929116 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b308d9c8-9759-4be8-9745-bad0b9d5a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:44.945590 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Flow 'volume_create_manager' (e5ed880c-d2f4-4de5-93a3-1811782a9461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:15:44.970176 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1fadc818-d9cc-4ec3-86b1-82d734a711e7 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Created volume successfully. Jan 15 21:15:45.759596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Lock "b'cinder-fee79ea4-666d-46ac-b249-f726739fc96a-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:15:45.831121 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:45.917812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:15:45.918507 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume volume-fee79ea4-666d-46ac-b249-f726739fc96a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:15:45.932864 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] deleting rbd volume volume-fee79ea4-666d-46ac-b249-f726739fc96a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:15:46.441123 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Created reservations ['9e8fa915-f883-41b6-bb26-ff5d5bceb2c8', '673e99a9-0af1-4d02-9679-8b35d79ba134', '6312d43d-298b-4d78-ad1c-815dfa7abeda', '627616f8-a888-4d61-83fa-fb2e9b6a96c2'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:15:46.558406 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:46.621294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:46.706394 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:15:46.710697 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Deleted volume successfully. Jan 15 21:15:46.730441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-b51c0594-7baf-46ea-ad27-ce79e4a087a6 tempest-VolumeQuotasAdminTestJSON-1049464655 None] Lock "b'cinder-fee79ea4-666d-46ac-b249-f726739fc96a-delete_volume'" released by "delete_volume" :: held 0.971s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:15:47.551744 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:15:47.559855 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:15:47.563483 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:15:47.626969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Flow 'volume_create_manager' (af148dcb-abed-4dc5-baf1-32274b1dd171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:15:47.651790 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6002d4-5a9b-44fc-8b04-1984c03dabc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:47.670961 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:15:47.699811 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6002d4-5a9b-44fc-8b04-1984c03dabc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-497830183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5610d2ef-f4cd-489b-ab6a-97c8073af4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa822dbc25964946a789d1f43eb3c1ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:15:47Z,use_quota=True,user_id='4e4a4e8d5fcf4d2295d04c9244e05721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:47.722626 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e42861d-0382-47c5-9cde-f99d6cbe4861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:47.735665 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e42861d-0382-47c5-9cde-f99d6cbe4861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:47.748649 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1c914f-1751-4660-90d2-c2faa636737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:47.759574 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1c914f-1751-4660-90d2-c2faa636737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5610d2ef-f4cd-489b-ab6a-97c8073af4e8', 'volume_name': 'volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:47.774132 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ce1df-390b-4c1b-b117-301cc9601733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:47.785018 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369ce1df-390b-4c1b-b117-301cc9601733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:47.806037 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf2cdea-785f-4ca7-bc0b-d35af90d954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:47.809146 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume 5610d2ef-f4cd-489b-ab6a-97c8073af4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8', 'volume_size': 1} Jan 15 21:15:47.813239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] creating volume 'volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:15:47.815115 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:47.960713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:15:47.961498 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:15:47.966515 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf2cdea-785f-4ca7-bc0b-d35af90d954f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:47.979465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82a3669-6cc3-4a17-a0e4-32b2c91a34e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:15:47.992070 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Volume volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8 (5610d2ef-f4cd-489b-ab6a-97c8073af4e8): created successfully Jan 15 21:15:48.001858 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82a3669-6cc3-4a17-a0e4-32b2c91a34e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:15:48.025081 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Flow 'volume_create_manager' (af148dcb-abed-4dc5-baf1-32274b1dd171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:15:48.060864 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-12d27b1e-4c6c-4658-92a4-f1fae68eb1ba tempest-VolumeQuotasAdminTestJSON-1049464655 None] Created volume successfully. Jan 15 21:15:49.289691 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-19c65e60-e7ea-4ab2-ba6e-c958847e7d50 tempest-VolumeQuotasAdminTestJSON-1099462324 None] Transfer volume completed successfully. Jan 15 21:15:49.702701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] Lock "b'cinder-5610d2ef-f4cd-489b-ab6a-97c8073af4e8-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:15:49.735268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:49.790183 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:15:49.791730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] Volume volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:15:49.804391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] deleting rbd volume volume-5610d2ef-f4cd-489b-ab6a-97c8073af4e8 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:15:50.194898 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] Created reservations ['5e4c6499-ab18-4f2c-a059-2c869e1bc3e7', '483b41ba-5fc3-480d-8ab7-5370b0975db0', '8413f2c6-22f5-44c4-9e30-dc64968d67c1', '60adb40c-ae5e-4077-88d2-e48f500d82ac'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:15:50.252733 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:50.320031 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:15:50.366330 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:15:50.383389 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] Deleted volume successfully. Jan 15 21:15:50.403707 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-fc04f0d2-aaf8-40db-815c-1160f208011e tempest-VolumeQuotasAdminTestJSON-604060442 None] Lock "b'cinder-5610d2ef-f4cd-489b-ab6a-97c8073af4e8-delete_volume'" released by "delete_volume" :: held 0.700s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:01.162571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:16:01.172719 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:16:01.174011 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:16:01.228665 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Flow 'volume_create_manager' (8e5d9c49-9867-4130-9537-762c69d97757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:16:01.239014 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e319562-e14a-4af4-93a9-71da8dbf93aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:01.247723 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:16:01.270296 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e319562-e14a-4af4-93a9-71da8dbf93aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-482134042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b32a04bd-5e65-46db-acbe-a28e9fe92d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb6b7f1fc4c4eb1bdd4a404a2e33d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:16:01Z,use_quota=True,user_id='173966ccf6604d41a5ee76489bbc3e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:01.276805 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df92b054-953c-44ca-ac34-b0d9881ba477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:01.282379 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df92b054-953c-44ca-ac34-b0d9881ba477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:01.288372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d65803-a578-4dfc-9192-4d7223d6dda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:01.293853 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d65803-a578-4dfc-9192-4d7223d6dda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32a04bd-5e65-46db-acbe-a28e9fe92d3c', 'volume_name': 'volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:01.299948 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e50f2db-ddd1-4e97-972c-0271b1c9a1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:01.304798 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e50f2db-ddd1-4e97-972c-0271b1c9a1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:01.310274 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb884584-6bc4-43d8-a5c8-a76869615f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:01.311961 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Volume b32a04bd-5e65-46db-acbe-a28e9fe92d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c', 'volume_size': 1} Jan 15 21:16:01.312538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] creating volume 'volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:16:01.313724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:01.412575 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:16:01.413082 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:16:01.416698 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb884584-6bc4-43d8-a5c8-a76869615f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:01.425508 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f358c7-158c-4506-b420-8dcf7a36d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:01.448079 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Volume volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c (b32a04bd-5e65-46db-acbe-a28e9fe92d3c): created successfully Jan 15 21:16:01.453274 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f358c7-158c-4506-b420-8dcf7a36d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:01.459958 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Flow 'volume_create_manager' (8e5d9c49-9867-4130-9537-762c69d97757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:16:01.479545 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6f4ccc76-5c7e-441d-9d2a-fc2708d39256 tempest-SnapshotMetadataTestJSON-375954416 None] Created volume successfully. Jan 15 21:16:02.802456 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0aaf0b6d-bb34-4251-8325-1fc7242255cc tempest-SnapshotMetadataTestJSON-375954416 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:03.521795 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0aaf0b6d-bb34-4251-8325-1fc7242255cc tempest-SnapshotMetadataTestJSON-375954416 None] Create snapshot completed successfully Jan 15 21:16:05.169294 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-cf1fb422-0718-4b6a-b72f-43274272fbf4 tempest-SnapshotMetadataTestJSON-375954416 None] Lock "b'cinder-26e3651d-f2f9-44d1-ae50-563ab7141dea-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.043s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:16:05.187937 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cf1fb422-0718-4b6a-b72f-43274272fbf4 tempest-SnapshotMetadataTestJSON-375954416 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:05.914746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-cf1fb422-0718-4b6a-b72f-43274272fbf4 tempest-SnapshotMetadataTestJSON-375954416 None] Created reservations ['faad4d5e-76de-48d2-ba07-f306a5d3fe1c', 'd2878702-1315-47f2-a541-8e8e8ceca366', 'f7c5e389-1db2-47a3-94af-9842aa3dc486', '13b33880-60d8-4dc6-9aab-a50302307260'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:16:05.984862 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-cf1fb422-0718-4b6a-b72f-43274272fbf4 tempest-SnapshotMetadataTestJSON-375954416 None] Delete snapshot completed successfully. Jan 15 21:16:05.992005 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-cf1fb422-0718-4b6a-b72f-43274272fbf4 tempest-SnapshotMetadataTestJSON-375954416 None] Lock "b'cinder-26e3651d-f2f9-44d1-ae50-563ab7141dea-delete_snapshot'" released by "delete_snapshot" :: held 0.825s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:06.318980 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] Lock "b'cinder-b32a04bd-5e65-46db-acbe-a28e9fe92d3c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:16:06.424804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:06.553393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:16:06.553823 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] Volume volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:16:06.566927 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] deleting rbd volume volume-b32a04bd-5e65-46db-acbe-a28e9fe92d3c {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:16:06.994337 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] Created reservations ['f9d0e843-74c4-4fce-8d5c-f6051023c68f', '9bcbaff7-0255-4e30-a710-ab209b6d4ba4', 'e4d3e501-3720-4d83-9942-75ac0eebf2b2', '8d3d7654-ac5e-4c60-bfd1-b12041a43167'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:16:07.076686 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:07.170683 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:07.236592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:16:07.241553 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] Deleted volume successfully. Jan 15 21:16:07.262101 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-2c705cb0-cd3e-4dcc-8445-592afb6a7ef1 tempest-SnapshotMetadataTestJSON-375954416 None] Lock "b'cinder-b32a04bd-5e65-46db-acbe-a28e9fe92d3c-delete_volume'" released by "delete_volume" :: held 0.943s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:15.009878 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:16:15.018365 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:16:15.018365 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:16:15.072639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Flow 'volume_create_manager' (07d330ea-ae14-4916-996b-b19bc3c110d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:16:15.105848 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8153547b-bd48-49e3-8d7e-ef6e12ccfda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:15.127583 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:16:15.174799 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8153547b-bd48-49e3-8d7e-ef6e12ccfda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-602566872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2c539f47-69f1-4a59-a458-c2efa6fdeab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd0eaa51a5b4c779f7ad5b939c9e905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:16:15Z,use_quota=True,user_id='edd5170384554dd799ce6c6cf182557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:15.182426 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7c0b29-abca-4473-8042-6b43eb104b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:15.194629 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7c0b29-abca-4473-8042-6b43eb104b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:15.213177 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1bb206-20af-497d-a24d-04b5ef24f717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:15.219020 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1bb206-20af-497d-a24d-04b5ef24f717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c539f47-69f1-4a59-a458-c2efa6fdeab3', 'volume_name': 'volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:15.225346 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48165d-ba34-44f3-a912-56898833cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:15.234625 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48165d-ba34-44f3-a912-56898833cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:15.252862 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0db7de9-c581-421b-bdd3-c6fafd5a0fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:15.255872 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Volume 2c539f47-69f1-4a59-a458-c2efa6fdeab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3', 'volume_size': 1} Jan 15 21:16:15.258494 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] creating volume 'volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:16:15.264339 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:15.443022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:16:15.443791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:16:15.449035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0db7de9-c581-421b-bdd3-c6fafd5a0fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:15.460354 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9af5e-51ee-4fef-aa53-a638464c7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:15.481195 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Volume volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3 (2c539f47-69f1-4a59-a458-c2efa6fdeab3): created successfully Jan 15 21:16:15.495047 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9af5e-51ee-4fef-aa53-a638464c7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:15.505905 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Flow 'volume_create_manager' (07d330ea-ae14-4916-996b-b19bc3c110d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:16:15.527556 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ceb80a76-3b33-47f3-be10-029a3af380e4 tempest-VolumesTransfersTest-1671517041 None] Created volume successfully. Jan 15 21:16:16.647587 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-fb6dae08-3539-4b1a-b04c-a9c1a630126c tempest-VolumesTransfersTest-1010684272 None] Transfer volume completed successfully. Jan 15 21:16:17.231477 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] Lock "b'cinder-2c539f47-69f1-4a59-a458-c2efa6fdeab3-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:16:17.307655 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:17.370923 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:16:17.381824 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] Volume volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:16:17.398802 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] deleting rbd volume volume-2c539f47-69f1-4a59-a458-c2efa6fdeab3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:16:17.699419 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] Created reservations ['06360977-4db9-411d-906c-ef8074616eeb', 'a34698a2-afd7-4856-b37a-5a1274c1f93b', 'b7dea4b0-d307-45b6-b70b-2dbe15cd777c', '51a882f8-d64c-4c19-a30f-fc73250314f4'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:16:17.743529 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:17.792263 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:17.837109 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:16:17.845294 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] Deleted volume successfully. Jan 15 21:16:17.861159 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-74628c76-69a1-460d-a3d6-32202a10b222 tempest-VolumesTransfersTest-1151681638 None] Lock "b'cinder-2c539f47-69f1-4a59-a458-c2efa6fdeab3-delete_volume'" released by "delete_volume" :: held 0.630s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:18.832683 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:16:18.835993 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:16:18.836637 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:16:18.855766 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Flow 'volume_create_manager' (1e227006-7307-4ad0-954d-055f233517f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:16:18.862922 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdde61c8-5260-4ce5-8999-087b77247389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:18.870135 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:16:18.885284 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdde61c8-5260-4ce5-8999-087b77247389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1243579002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=25b837a0-a6d6-4410-860b-7e678e29b5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd0eaa51a5b4c779f7ad5b939c9e905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:16:19Z,use_quota=True,user_id='edd5170384554dd799ce6c6cf182557b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:18.890816 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a34353c-e4e7-4eda-bce4-905509ec7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:18.894999 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a34353c-e4e7-4eda-bce4-905509ec7275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:18.900168 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17b090c-daa9-47d8-958b-209d5cac9e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:18.904415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17b090c-daa9-47d8-958b-209d5cac9e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b837a0-a6d6-4410-860b-7e678e29b5a3', 'volume_name': 'volume-25b837a0-a6d6-4410-860b-7e678e29b5a3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:18.909963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f55991c-40e8-4857-8fc3-528bbd7bfe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:18.914349 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f55991c-40e8-4857-8fc3-528bbd7bfe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:18.919533 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d20cfd-7d07-42c1-9747-56e57849ec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:18.920181 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Volume 25b837a0-a6d6-4410-860b-7e678e29b5a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b837a0-a6d6-4410-860b-7e678e29b5a3', 'volume_size': 1} Jan 15 21:16:18.921140 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] creating volume 'volume-25b837a0-a6d6-4410-860b-7e678e29b5a3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:16:18.922107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:18.989460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:16:18.990676 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:16:18.996143 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d20cfd-7d07-42c1-9747-56e57849ec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b837a0-a6d6-4410-860b-7e678e29b5a3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:19.002559 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af88cd67-fca5-4a0f-9506-9229d0fc7cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:16:19.013355 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Volume volume-25b837a0-a6d6-4410-860b-7e678e29b5a3 (25b837a0-a6d6-4410-860b-7e678e29b5a3): created successfully Jan 15 21:16:19.018126 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af88cd67-fca5-4a0f-9506-9229d0fc7cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:16:19.024408 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Flow 'volume_create_manager' (1e227006-7307-4ad0-954d-055f233517f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:16:19.034687 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-15ac2c7e-bd59-4493-be1c-a3614cc7f690 tempest-VolumesTransfersTest-1671517041 None] Created volume successfully. Jan 15 21:16:20.132074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] Lock "b'cinder-25b837a0-a6d6-4410-860b-7e678e29b5a3-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:16:20.176784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:20.251163 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:16:20.251824 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] Volume volume-25b837a0-a6d6-4410-860b-7e678e29b5a3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:16:20.261593 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] deleting rbd volume volume-25b837a0-a6d6-4410-860b-7e678e29b5a3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:16:20.678879 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] Created reservations ['cf83f66a-4596-48d8-9b58-615e8bc0341c', '2976ba70-e72c-44bc-a8a0-a937591ca9d8', '6f18ce09-21d6-40b0-87ba-03c43eee313a', '50bffdb2-a8f5-456c-b468-d2e063cc143d'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:16:20.778228 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:20.861871 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:20.944939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:16:20.949072 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] Deleted volume successfully. Jan 15 21:16:20.972275 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-32b7872f-7a5e-4655-869f-e7bc6d07c294 tempest-VolumesTransfersTest-1151681638 None] Lock "b'cinder-25b837a0-a6d6-4410-860b-7e678e29b5a3-delete_volume'" released by "delete_volume" :: held 0.840s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:36.212813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] Lock "b'cinder-856107bf-7053-4ece-a849-e0b2c800dc88-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:16:36.262677 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:36.318643 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:16:36.319440 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] Volume volume-856107bf-7053-4ece-a849-e0b2c800dc88 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:16:36.327357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] deleting rbd volume volume-856107bf-7053-4ece-a849-e0b2c800dc88 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:16:36.763066 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] Created reservations ['adf3aa88-01e0-4583-8191-be86e4e7d355', '8f308770-83c8-4bde-9cf3-8d0fe9f027a0', '8c088581-b1fe-42ba-b8a0-735f5533c4c4', '5ad6e3f1-3d25-409c-b8b0-46c0ce64d7bd'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:16:36.846648 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:36.944258 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:37.018035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:16:37.026172 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] Deleted volume successfully. Jan 15 21:16:37.049910 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-77a395bd-ff33-4fd1-905b-2e13ad8ccd12 tempest-ServersNegativeTestJSON-1331787346 None] Lock "b'cinder-856107bf-7053-4ece-a849-e0b2c800dc88-delete_volume'" released by "delete_volume" :: held 0.837s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:37.429638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] Lock "b'cinder-304a8d50-c297-4024-a907-a1bd0aed3922-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:16:37.522608 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:37.628620 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:16:37.629173 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] Volume volume-304a8d50-c297-4024-a907-a1bd0aed3922 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:16:37.640569 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] deleting rbd volume volume-304a8d50-c297-4024-a907-a1bd0aed3922 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:16:38.060770 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] Created reservations ['a17646e5-127d-4570-a3e3-156f14de8989', 'b4346a4f-6dd0-4996-8fab-ce9d1700a732', 'bddec991-476d-4e17-bf57-54bb16865bc5', 'deb931eb-1884-4c03-8e11-673fbb7d66e9'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:16:38.173139 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:38.237341 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:38.305043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:16:38.315285 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] Deleted volume successfully. Jan 15 21:16:38.339440 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7ab506e6-3044-497d-b763-565a48dee430 tempest-ServersNegativeTestJSON-1331787346 None] Lock "b'cinder-304a8d50-c297-4024-a907-a1bd0aed3922-delete_volume'" released by "delete_volume" :: held 0.910s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:16:41.323502 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:16:41.324151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:41.364998 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:16:41.411252 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:17:33.228700 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3ad66872-aa9d-49ed-b8f2-7c7cb0a7f50a tempest-GroupSnapshotsTest-275193259 None] Group tempest-GroupSnapshotsTest-Group-1442736370: creating Jan 15 21:17:33.248121 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3ad66872-aa9d-49ed-b8f2-7c7cb0a7f50a tempest-GroupSnapshotsTest-275193259 None] Group tempest-GroupSnapshotsTest-Group-1442736370: created successfully Jan 15 21:17:33.257624 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3ad66872-aa9d-49ed-b8f2-7c7cb0a7f50a tempest-GroupSnapshotsTest-275193259 None] Create group completed successfully. Jan 15 21:17:34.988662 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:17:34.997807 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:17:34.998706 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:17:35.025738 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (7fae7d01-9dc0-4a71-a005-780505d76456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:17:35.033240 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f366f03-5650-4dc2-896b-9e8d224a7dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:35.043573 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:17:35.058802 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f366f03-5650-4dc2-896b-9e8d224a7dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1049959714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46babe51-37ca-42cb-ab2c-7d1eadf1867f,host='ncdv-master-1@ceph#ceph',id=fa40c706-4f6e-4aee-8cdc-b2157cc63bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971a4f7666648daa3dcf1a030f12a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:17:35Z,use_quota=True,user_id='07ecdcfa80e14707adbb4f7f2be10d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79d217d6-9f9c-4161-871a-0ac4176ed1c3),volume_type_id=79d217d6-9f9c-4161-871a-0ac4176ed1c3)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:35.068043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2988cc5c-5248-4c39-819c-0539f72ec2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:35.076075 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2988cc5c-5248-4c39-819c-0539f72ec2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:35.082171 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d522439-be1c-4b00-a0f6-67586be1d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:35.087427 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d522439-be1c-4b00-a0f6-67586be1d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa40c706-4f6e-4aee-8cdc-b2157cc63bd3', 'volume_name': 'volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:35.094239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7f0f8d-f17c-4323-b30b-49c1aceb7c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:35.099681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7f0f8d-f17c-4323-b30b-49c1aceb7c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:35.105815 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aa7883-05c5-46ae-8236-3568f6f93c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:35.107221 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Volume fa40c706-4f6e-4aee-8cdc-b2157cc63bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3', 'volume_size': 1} Jan 15 21:17:35.108313 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] creating volume 'volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:17:35.109555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:35.211526 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:17:35.211898 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:17:35.216074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aa7883-05c5-46ae-8236-3568f6f93c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:35.221001 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c61c54c-06ae-4318-a83c-9176e5094f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:35.241029 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Volume volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3 (fa40c706-4f6e-4aee-8cdc-b2157cc63bd3): created successfully Jan 15 21:17:35.245115 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c61c54c-06ae-4318-a83c-9176e5094f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:35.251438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (7fae7d01-9dc0-4a71-a005-780505d76456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:17:35.262425 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8674633c-abda-46f1-a744-c12d2ea40511 tempest-GroupSnapshotsTest-275193259 None] Created volume successfully. Jan 15 21:17:36.380281 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a6857974-01d5-41bb-a08b-824c27d5eeab tempest-GroupSnapshotsTest-275193259 None] GroupSnapshot c233b323-8366-488c-87b5-b5afdb45a86d: creating. Jan 15 21:17:36.411675 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a6857974-01d5-41bb-a08b-824c27d5eeab tempest-GroupSnapshotsTest-275193259 None] Group snapshot c233b323-8366-488c-87b5-b5afdb45a86d: creating. {{(pid=122725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Jan 15 21:17:36.433435 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a6857974-01d5-41bb-a08b-824c27d5eeab tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:37.054252 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a6857974-01d5-41bb-a08b-824c27d5eeab tempest-GroupSnapshotsTest-275193259 None] group_snapshot c233b323-8366-488c-87b5-b5afdb45a86d: created successfully Jan 15 21:17:38.395950 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ff343d10-a10c-4f66-9060-1909b581a4a3 tempest-GroupSnapshotsTest-275193259 None] cloning volumes/volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3@snapshot-988d9760-e7e0-4573-9937-36f22795873b to volume-095c2b7c-d8d1-4eb5-b005-b947f6d9581b {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:17:38.396614 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ff343d10-a10c-4f66-9060-1909b581a4a3 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:38.457256 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ff343d10-a10c-4f66-9060-1909b581a4a3 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:38.647939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ff343d10-a10c-4f66-9060-1909b581a4a3 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:17:38.648326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ff343d10-a10c-4f66-9060-1909b581a4a3 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:17:38.758437 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ff343d10-a10c-4f66-9060-1909b581a4a3 tempest-GroupSnapshotsTest-275193259 None] Create group from source-snapshot-c233b323-8366-488c-87b5-b5afdb45a86d completed successfully. Jan 15 21:17:40.178485 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:40.295546 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:17:40.306709 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] deleting rbd volume volume-095c2b7c-d8d1-4eb5-b005-b947f6d9581b {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:17:40.713150 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] Created reservations ['eab73839-f255-49ed-b710-1fd000fec881'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:40.759751 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1772946780 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1772946780, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:17:40.765527 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1772946780 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1772946780, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:17:40.797422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] Created reservations ['52770a48-8c9e-426f-8c36-c8d4fc061413', 'd971f0cc-ea87-43a1-a1ad-23be4f8b1bf1', 'a8e404d5-8962-4490-a689-a70d592dac69', '047b23bd-b615-4fc1-8575-b75127bd52c2'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:40.960038 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:41.024229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:41.097836 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:17:41.112822 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-28a88596-2d81-4fed-b697-8edb82bb65de tempest-GroupSnapshotsTest-275193259 None] Delete group completed successfully. Jan 15 21:17:41.330966 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:17:41.332271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:41.407496 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:41.480449 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:17:41.486074 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-17b11f91-b968-43e4-9959-e94ced1c8eb2 tempest-GroupSnapshotsTest-275193259 None] group_snapshot c233b323-8366-488c-87b5-b5afdb45a86d: deleting Jan 15 21:17:41.530924 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-17b11f91-b968-43e4-9959-e94ced1c8eb2 tempest-GroupSnapshotsTest-275193259 None] group_snapshot c233b323-8366-488c-87b5-b5afdb45a86d: deleting {{(pid=122725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Jan 15 21:17:41.579908 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-17b11f91-b968-43e4-9959-e94ced1c8eb2 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:42.503259 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-17b11f91-b968-43e4-9959-e94ced1c8eb2 tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1772946780 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1772946780, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:17:42.523640 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-17b11f91-b968-43e4-9959-e94ced1c8eb2 tempest-GroupSnapshotsTest-275193259 None] Created reservations ['1b65e93f-36d9-43f7-ba31-c52f36d33b04', '258c6100-5f25-4b82-bbf4-5c59d5426ded', 'f2903dc1-bce8-471e-97c0-c1029fefe761', '6c8080cc-dd0f-4f94-aeea-dcb4a177aebc'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:42.630782 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-17b11f91-b968-43e4-9959-e94ced1c8eb2 tempest-GroupSnapshotsTest-275193259 None] group_snapshot c233b323-8366-488c-87b5-b5afdb45a86d: deleted successfully Jan 15 21:17:43.156162 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:43.264258 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:17:43.264766 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] Volume volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:17:43.275591 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] deleting rbd volume volume-fa40c706-4f6e-4aee-8cdc-b2157cc63bd3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:17:43.671760 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] Created reservations ['63435ff2-e153-4400-857d-e479150f70c8'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:43.719086 ncdv-master-1 cinder-volume[122725]: WARNING cinder.db.sqlalchemy.api [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1772946780'] Jan 15 21:17:43.723043 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] Created reservations ['d8438624-c3a5-40e1-adb1-c4c3c4788115', 'f3140887-4a59-4ea8-a9a7-052333c2751c', 'cfa3e8fb-0878-405f-86c3-6031d07aa81b', 'c0043a01-c1d7-4daf-8ac9-5f1617fe4871'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:43.814019 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:43.874160 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:43.921495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:17:43.926735 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-cb379df8-2f23-4c05-9dea-e08b5576192d tempest-GroupSnapshotsTest-275193259 None] Delete group completed successfully. Jan 15 21:17:44.628790 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0cc6b29f-f4f7-4f60-a3c0-ba287ae7c3c4 tempest-GroupSnapshotsTest-275193259 None] Group tempest-GroupSnapshotsTest-Group-115385786: creating Jan 15 21:17:44.650482 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0cc6b29f-f4f7-4f60-a3c0-ba287ae7c3c4 tempest-GroupSnapshotsTest-275193259 None] Group tempest-GroupSnapshotsTest-Group-115385786: created successfully Jan 15 21:17:44.661339 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0cc6b29f-f4f7-4f60-a3c0-ba287ae7c3c4 tempest-GroupSnapshotsTest-275193259 None] Create group completed successfully. Jan 15 21:17:46.135704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:17:46.147479 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:17:46.148182 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:17:46.185823 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (1158f9ed-2a4e-4c7c-99da-2bd2e46c2cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:17:46.193419 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb0cf03-a807-4883-bdad-d057b42df258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:46.203289 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:17:46.224614 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb0cf03-a807-4883-bdad-d057b42df258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2027076264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f31b3ea-1214-4676-bd0b-8eca6b84e8f8,host='ncdv-master-1@ceph#ceph',id=fa4e2b29-bdf2-4bb5-9876-08cb99db03d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971a4f7666648daa3dcf1a030f12a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:17:46Z,use_quota=True,user_id='07ecdcfa80e14707adbb4f7f2be10d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141ef67d-c329-41f3-b80e-407a4a62cd5c),volume_type_id=141ef67d-c329-41f3-b80e-407a4a62cd5c)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:46.231417 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa329e3-e126-42a0-9f22-f90f475ed462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:46.236913 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa329e3-e126-42a0-9f22-f90f475ed462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:46.244175 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acbb46c-c46f-426b-8a78-9e8afa9f500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:46.249701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acbb46c-c46f-426b-8a78-9e8afa9f500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4e2b29-bdf2-4bb5-9876-08cb99db03d3', 'volume_name': 'volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:46.255630 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1742f-2e6d-47bc-8bd4-71ef7e9bcc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:46.261504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1742f-2e6d-47bc-8bd4-71ef7e9bcc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:46.266595 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db12250e-7824-435a-8eb9-798b999a6096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:46.268332 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Volume fa4e2b29-bdf2-4bb5-9876-08cb99db03d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3', 'volume_size': 1} Jan 15 21:17:46.268878 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] creating volume 'volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:17:46.270039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:46.365153 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:17:46.365557 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:17:46.377716 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db12250e-7824-435a-8eb9-798b999a6096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:46.383165 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d234207e-9aa5-479d-b3be-9bce304f9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:46.394348 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Volume volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3 (fa4e2b29-bdf2-4bb5-9876-08cb99db03d3): created successfully Jan 15 21:17:46.400079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d234207e-9aa5-479d-b3be-9bce304f9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:46.421372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (1158f9ed-2a4e-4c7c-99da-2bd2e46c2cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:17:46.432166 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-66f6f585-1342-4d6c-8675-719cdf295d11 tempest-GroupSnapshotsTest-275193259 None] Created volume successfully. Jan 15 21:17:47.668161 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:17:47.672729 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:17:47.673281 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:17:47.717040 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (5da36d87-6233-49d4-924c-dd82b0e2bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:17:47.726245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d823c1-0471-4a77-8265-39b9e2126051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:47.735824 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:17:47.761438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d823c1-0471-4a77-8265-39b9e2126051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-515503683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f31b3ea-1214-4676-bd0b-8eca6b84e8f8,host='ncdv-master-1@ceph#ceph',id=df24af3d-ecda-46a9-93ac-ae918461228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971a4f7666648daa3dcf1a030f12a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:17:48Z,use_quota=True,user_id='07ecdcfa80e14707adbb4f7f2be10d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(141ef67d-c329-41f3-b80e-407a4a62cd5c),volume_type_id=141ef67d-c329-41f3-b80e-407a4a62cd5c)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:47.772523 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcf1f7a-813b-4222-a875-cc5ef8055288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:47.780690 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcf1f7a-813b-4222-a875-cc5ef8055288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:47.790956 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e94788-9814-4103-a3b1-8d7e5be68fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:47.795557 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e94788-9814-4103-a3b1-8d7e5be68fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df24af3d-ecda-46a9-93ac-ae918461228b', 'volume_name': 'volume-df24af3d-ecda-46a9-93ac-ae918461228b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:47.800864 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c737f6-ffb1-4b41-ba64-c7f720130daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:47.805483 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c737f6-ffb1-4b41-ba64-c7f720130daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:47.811704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab7ca01-2e08-410a-84d4-328261c6e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:47.813773 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Volume df24af3d-ecda-46a9-93ac-ae918461228b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df24af3d-ecda-46a9-93ac-ae918461228b', 'volume_size': 1} Jan 15 21:17:47.814187 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] creating volume 'volume-df24af3d-ecda-46a9-93ac-ae918461228b' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:17:47.815244 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:47.894571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:17:47.894946 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:17:47.898874 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab7ca01-2e08-410a-84d4-328261c6e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df24af3d-ecda-46a9-93ac-ae918461228b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:47.906145 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a68d44-c80a-4108-aa3e-c962147afba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:17:47.917815 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Volume volume-df24af3d-ecda-46a9-93ac-ae918461228b (df24af3d-ecda-46a9-93ac-ae918461228b): created successfully Jan 15 21:17:47.922957 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a68d44-c80a-4108-aa3e-c962147afba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:17:47.930411 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (5da36d87-6233-49d4-924c-dd82b0e2bca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:17:47.951355 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1a605835-30af-4384-bca9-88e0ae775735 tempest-GroupSnapshotsTest-275193259 None] Created volume successfully. Jan 15 21:17:48.769397 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a5e58e1c-7136-4934-84b7-46e2bc794b7c tempest-GroupSnapshotsTest-275193259 None] Update group completed successfully. Jan 15 21:17:49.930535 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c259b12f-8580-408c-9a06-488eea19e8db tempest-GroupSnapshotsTest-275193259 None] Update group completed successfully. Jan 15 21:17:51.058760 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-5d38683e-8557-444e-96cf-1dd8c1dbd77a tempest-GroupSnapshotsTest-275193259 None] Update group completed successfully. Jan 15 21:17:52.187982 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7c703af2-381a-4b27-a62f-2f693faec0a4 tempest-GroupSnapshotsTest-275193259 None] Update group completed successfully. Jan 15 21:17:53.513024 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7c60d163-f99d-4083-b4a9-6d3415b32022 tempest-GroupSnapshotsTest-275193259 None] GroupSnapshot 84e51e25-04ee-4125-8090-be8b786f75fb: creating. Jan 15 21:17:53.532978 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7c60d163-f99d-4083-b4a9-6d3415b32022 tempest-GroupSnapshotsTest-275193259 None] Group snapshot 84e51e25-04ee-4125-8090-be8b786f75fb: creating. {{(pid=122725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Jan 15 21:17:53.554330 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c60d163-f99d-4083-b4a9-6d3415b32022 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:54.456054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7c60d163-f99d-4083-b4a9-6d3415b32022 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:55.551589 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7c60d163-f99d-4083-b4a9-6d3415b32022 tempest-GroupSnapshotsTest-275193259 None] group_snapshot 84e51e25-04ee-4125-8090-be8b786f75fb: created successfully Jan 15 21:17:55.768895 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] group_snapshot 84e51e25-04ee-4125-8090-be8b786f75fb: deleting Jan 15 21:17:55.786973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] group_snapshot 84e51e25-04ee-4125-8090-be8b786f75fb: deleting {{(pid=122725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Jan 15 21:17:55.806647 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:56.957255 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:58.015076 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1005200939 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1005200939, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:17:58.016583 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1005200939 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1005200939, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:17:58.034936 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] Created reservations ['b48a7d17-7da8-4085-be9d-a7f452c00bc1', 'bc39c0d0-1015-4503-a8fa-0521e61685ef', '0596e85b-714d-46b7-be3d-cc24c8e99eaa', 'ba38b620-1e4f-446b-ac5d-e28a63c6bece'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:58.130694 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] Created reservations ['68d05cba-83f7-4e68-8201-182015ad1786', '11f33cb2-faa5-44ab-9e63-0785548b0487', 'e31b2292-69cf-4166-925b-517d8b42841e', '5d2fb86b-5b36-485f-a42a-f00a5e1939ca'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:17:58.174127 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-978f03b1-77ce-439f-8ad9-948338b20b4c tempest-GroupSnapshotsTest-275193259 None] group_snapshot 84e51e25-04ee-4125-8090-be8b786f75fb: deleted successfully Jan 15 21:17:59.501758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:59.589496 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:17:59.589994 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Volume volume-df24af3d-ecda-46a9-93ac-ae918461228b is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:17:59.600729 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] deleting rbd volume volume-df24af3d-ecda-46a9-93ac-ae918461228b {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:17:59.863224 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:17:59.923136 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:17:59.923560 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Volume volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:17:59.929100 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] deleting rbd volume volume-fa4e2b29-bdf2-4bb5-9876-08cb99db03d3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:18:00.191500 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Created reservations ['ca09ab1d-5a2f-4495-b92a-56f011dd423f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:00.210741 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1005200939 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1005200939, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:00.239650 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Created reservations ['6b0651c9-8917-4efb-8873-69bd4fb2df73', '588f3dbb-7178-4234-8525-480119b33dea', 'f8f24a20-64c2-4fb6-843f-4d2f97dfcb5d', 'cfe4562a-c56d-446a-a8c0-90e9775688a9'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:00.323697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Created reservations ['13da9ebe-dfcf-464e-abb9-354f35e78fed', '359106b4-7e67-4346-9ca4-d821324cd0b5', 'd69b0013-83d8-405a-bd3d-1a744a94baa0', 'c157557d-00cc-41c9-8ba6-273a0755b14d'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:00.404871 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:00.458983 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:00.499845 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:00.505405 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ac33b567-d258-4d1a-a82b-2d0dfb224c51 tempest-GroupSnapshotsTest-275193259 None] Delete group completed successfully. Jan 15 21:18:00.918747 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2bbfeb48-cccd-4f4e-a038-fe7f23273898 tempest-GroupSnapshotsTest-275193259 None] Group tempest-GroupSnapshotsTest-Group-342343176: creating Jan 15 21:18:00.945263 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2bbfeb48-cccd-4f4e-a038-fe7f23273898 tempest-GroupSnapshotsTest-275193259 None] Group tempest-GroupSnapshotsTest-Group-342343176: created successfully Jan 15 21:18:00.968302 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2bbfeb48-cccd-4f4e-a038-fe7f23273898 tempest-GroupSnapshotsTest-275193259 None] Create group completed successfully. Jan 15 21:18:02.483148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:02.486419 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:02.486872 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:02.506540 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (ccdb97ec-d5fd-4094-83bf-ee6ab8711677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:02.514138 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5939ad8c-a11c-4f87-9687-35458752cf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:02.521372 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:02.538186 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5939ad8c-a11c-4f87-9687-35458752cf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2140589779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39d59f2c-7625-4fee-a7c6-2d32990378b1,host='ncdv-master-1@ceph#ceph',id=3ad37c6c-adba-4b5c-8006-7115d19544c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6971a4f7666648daa3dcf1a030f12a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:02Z,use_quota=True,user_id='07ecdcfa80e14707adbb4f7f2be10d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a449f254-abc0-48bd-ac89-00bad3a470cc),volume_type_id=a449f254-abc0-48bd-ac89-00bad3a470cc)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:02.544091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fd6359-1f47-4130-9672-5c38b6ae980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:02.548442 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fd6359-1f47-4130-9672-5c38b6ae980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:02.553784 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affedc10-89d6-4f20-ac0e-4c7043c31d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:02.559176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affedc10-89d6-4f20-ac0e-4c7043c31d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad37c6c-adba-4b5c-8006-7115d19544c3', 'volume_name': 'volume-3ad37c6c-adba-4b5c-8006-7115d19544c3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:02.564253 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61163da6-70af-4600-bf2f-a3aee69e62f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:02.568458 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61163da6-70af-4600-bf2f-a3aee69e62f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:02.574135 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd42c366-e12c-4347-a0ea-3cf39cc3d492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:02.575343 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Volume 3ad37c6c-adba-4b5c-8006-7115d19544c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad37c6c-adba-4b5c-8006-7115d19544c3', 'volume_size': 1} Jan 15 21:18:02.575855 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] creating volume 'volume-3ad37c6c-adba-4b5c-8006-7115d19544c3' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:18:02.576754 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:02.661952 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:02.662331 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:02.666951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd42c366-e12c-4347-a0ea-3cf39cc3d492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad37c6c-adba-4b5c-8006-7115d19544c3', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:02.671650 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b74da13-5e85-4a59-8563-7d19441cb6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:02.680984 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Volume volume-3ad37c6c-adba-4b5c-8006-7115d19544c3 (3ad37c6c-adba-4b5c-8006-7115d19544c3): created successfully Jan 15 21:18:02.685468 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b74da13-5e85-4a59-8563-7d19441cb6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:02.691182 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Flow 'volume_create_manager' (ccdb97ec-d5fd-4094-83bf-ee6ab8711677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:02.700206 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a44d78e3-87f9-46b6-a80d-ba6eb1025176 tempest-GroupSnapshotsTest-275193259 None] Created volume successfully. Jan 15 21:18:03.737602 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f29d2432-9083-4857-beaa-1465a4f67ed8 tempest-GroupSnapshotsTest-275193259 None] GroupSnapshot 1366aa1e-35b7-43bd-81ae-5988099c1c70: creating. Jan 15 21:18:03.770617 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f29d2432-9083-4857-beaa-1465a4f67ed8 tempest-GroupSnapshotsTest-275193259 None] Group snapshot 1366aa1e-35b7-43bd-81ae-5988099c1c70: creating. {{(pid=122725) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} Jan 15 21:18:03.789468 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f29d2432-9083-4857-beaa-1465a4f67ed8 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:04.456351 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f29d2432-9083-4857-beaa-1465a4f67ed8 tempest-GroupSnapshotsTest-275193259 None] group_snapshot 1366aa1e-35b7-43bd-81ae-5988099c1c70: created successfully Jan 15 21:18:05.009001 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] group_snapshot 1366aa1e-35b7-43bd-81ae-5988099c1c70: deleting Jan 15 21:18:05.031271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] group_snapshot 1366aa1e-35b7-43bd-81ae-5988099c1c70: deleting {{(pid=122725) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} Jan 15 21:18:05.053158 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:06.021850 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-513049076 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-513049076, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:06.022543 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-513049076 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-513049076, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:06.040380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] Created reservations ['8a3bbf6a-a4c3-462d-8df7-ac7ada23e630', '65b2906e-d503-48c9-a560-7594db5e8e20', '662e2931-10a8-4d6a-b696-f08832a2efd8', 'c3cfa317-cd53-44ee-be01-f21e420531c8'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:06.098504 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8cd7b21c-d753-49ea-b342-64c3b6ec0eee tempest-GroupSnapshotsTest-275193259 None] group_snapshot 1366aa1e-35b7-43bd-81ae-5988099c1c70: deleted successfully Jan 15 21:18:06.486631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:06.545926 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:18:06.546349 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] Volume volume-3ad37c6c-adba-4b5c-8006-7115d19544c3 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:18:06.554423 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] deleting rbd volume volume-3ad37c6c-adba-4b5c-8006-7115d19544c3 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:18:06.834219 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] Created reservations ['90a10e5a-e705-4ee2-b523-ac24b3dde1ce'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:06.855755 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-513049076 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-513049076, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:06.874316 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] Created reservations ['bcd00bcf-ac62-49c4-b0c8-70e8ce1c27ec', 'f1af9be7-6bc8-4d3f-8646-3207da981718', 'c6b4141a-c660-4156-9868-6c804de6d1ba', 'db0d4517-d230-4c67-bbab-cdff848e877c'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:06.972332 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:07.026496 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:07.076071 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:07.087029 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9b6700ba-929c-41d7-b5ee-8144208a7159 tempest-GroupSnapshotsTest-275193259 None] Delete group completed successfully. Jan 15 21:18:12.347366 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2a6eed15-bdc4-48dd-bda5-42760ad63f2f tempest-GroupsTest-965852599 None] Group tempest-Group1-588967552: creating Jan 15 21:18:12.387417 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2a6eed15-bdc4-48dd-bda5-42760ad63f2f tempest-GroupsTest-965852599 None] Group tempest-Group1-588967552: created successfully Jan 15 21:18:12.397026 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-2a6eed15-bdc4-48dd-bda5-42760ad63f2f tempest-GroupsTest-965852599 None] Create group completed successfully. Jan 15 21:18:13.646031 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-98ef57aa-b1d2-4ffa-b645-6ccfcb6527d8 tempest-GroupsTest-965852599 None] Group tempest-Group2-712066455: creating Jan 15 21:18:13.683593 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-98ef57aa-b1d2-4ffa-b645-6ccfcb6527d8 tempest-GroupsTest-965852599 None] Group tempest-Group2-712066455: created successfully Jan 15 21:18:13.705124 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-98ef57aa-b1d2-4ffa-b645-6ccfcb6527d8 tempest-GroupsTest-965852599 None] Create group completed successfully. Jan 15 21:18:15.340342 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:15.347793 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:15.348950 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:15.414297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Flow 'volume_create_manager' (19bc983b-67eb-49d8-b6b6-1bfe422f388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:15.427103 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efef8208-dbc8-4933-8004-cc576686f233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:15.447996 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:15.473305 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efef8208-dbc8-4933-8004-cc576686f233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233387136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd17d88c-6b6e-4ca4-9709-4a4cbb85bf61,host='ncdv-master-1@ceph#ceph',id=ba9f1645-ad17-449f-ad6c-e77edc180955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0efe6af4849d6b69cfef20aecf802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:15Z,use_quota=True,user_id='b01c0d8165764b4a97189a09a9b7b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77ed2795-bbd9-4645-a7ff-99d6aec922a9),volume_type_id=77ed2795-bbd9-4645-a7ff-99d6aec922a9)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:15.484672 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839a6f6a-849b-4232-b719-16a8711197cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:15.494698 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839a6f6a-849b-4232-b719-16a8711197cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:15.514345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6b0ef1-7fb7-4204-9e25-0a5cbce1712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:15.519114 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6b0ef1-7fb7-4204-9e25-0a5cbce1712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9f1645-ad17-449f-ad6c-e77edc180955', 'volume_name': 'volume-ba9f1645-ad17-449f-ad6c-e77edc180955', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:15.531755 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d329ddf8-1361-44d5-a69a-8e63420dc1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:15.537179 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d329ddf8-1361-44d5-a69a-8e63420dc1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:15.548436 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba6d5f5-191f-4571-877d-535d4e628972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:15.550386 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Volume ba9f1645-ad17-449f-ad6c-e77edc180955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9f1645-ad17-449f-ad6c-e77edc180955', 'volume_size': 1} Jan 15 21:18:15.551059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] creating volume 'volume-ba9f1645-ad17-449f-ad6c-e77edc180955' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:18:15.552211 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:15.651484 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:15.652106 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:15.660024 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba6d5f5-191f-4571-877d-535d4e628972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9f1645-ad17-449f-ad6c-e77edc180955', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:15.669091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca22dc9-8a84-4241-b6d0-ed09f0c7244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:15.682140 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Volume volume-ba9f1645-ad17-449f-ad6c-e77edc180955 (ba9f1645-ad17-449f-ad6c-e77edc180955): created successfully Jan 15 21:18:15.686804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca22dc9-8a84-4241-b6d0-ed09f0c7244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:15.693762 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Flow 'volume_create_manager' (19bc983b-67eb-49d8-b6b6-1bfe422f388a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:15.706235 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-09d65910-2ac1-43a1-a176-d9202d046fb7 tempest-GroupsTest-965852599 None] Created volume successfully. Jan 15 21:18:17.079333 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:17.168375 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:18:17.169297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Volume volume-ba9f1645-ad17-449f-ad6c-e77edc180955 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:18:17.180178 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] deleting rbd volume volume-ba9f1645-ad17-449f-ad6c-e77edc180955 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:18:17.478836 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Created reservations ['4c10ddc8-3fd3-44c5-984e-863f6e851407'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:17.498039 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1294311948 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1294311948, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:17.498995 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1294311948 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1294311948, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:17.515857 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Created reservations ['f4905c1f-ef5b-4a28-8f7c-68b97af4e16c', '8c59a021-2645-492b-86c8-51f1da4ff50b', 'e74c23fc-d8b3-4827-8951-a595f05c607a', '9c211860-963d-4943-b961-15d111c632b0'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:17.607921 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:17.652393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:17.710012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:17.719246 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a2d42f1f-1e72-45e7-9738-82d461e7f298 tempest-GroupsTest-965852599 None] Delete group completed successfully. Jan 15 21:18:18.483905 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-0bc9e219-2a4a-4455-9094-de70b2687fba tempest-GroupsTest-965852599 None] Created reservations ['5af9f671-0c43-4d56-b4dc-f203385eccf4'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:18.565798 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0bc9e219-2a4a-4455-9094-de70b2687fba tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:18.638334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0bc9e219-2a4a-4455-9094-de70b2687fba tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:18.679705 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-0bc9e219-2a4a-4455-9094-de70b2687fba tempest-GroupsTest-965852599 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:18.685015 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0bc9e219-2a4a-4455-9094-de70b2687fba tempest-GroupsTest-965852599 None] Delete group completed successfully. Jan 15 21:18:20.085469 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1cb09b88-ee66-479f-ae21-0f47ae501af2 tempest-GroupsTest-965852599 None] Group tempest-GroupsTest-Group-1201494218: creating Jan 15 21:18:20.123479 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1cb09b88-ee66-479f-ae21-0f47ae501af2 tempest-GroupsTest-965852599 None] Group tempest-GroupsTest-Group-1201494218: created successfully Jan 15 21:18:20.142230 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1cb09b88-ee66-479f-ae21-0f47ae501af2 tempest-GroupsTest-965852599 None] Create group completed successfully. Jan 15 21:18:21.757919 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:21.761747 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:21.762204 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:21.792624 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Flow 'volume_create_manager' (c86fb31b-d9d1-4797-8a77-96ba42ac4135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:21.801526 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b885cd64-f536-4523-a5d8-fbfd77909304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:21.811620 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:21.834724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b885cd64-f536-4523-a5d8-fbfd77909304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-80136160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dfd5fddc-7d02-4fbb-995b-cdc76f3b9acb,host='ncdv-master-1@ceph#ceph',id=df1c598e-a460-4159-8729-da00b1a10224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0efe6af4849d6b69cfef20aecf802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:22Z,use_quota=True,user_id='b01c0d8165764b4a97189a09a9b7b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb0424e0-d4d6-45c4-bd17-ff46763fff08),volume_type_id=cb0424e0-d4d6-45c4-bd17-ff46763fff08)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:21.844306 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19f4ff4-4ac6-4adc-9c49-b1c0df9d5179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:21.851890 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19f4ff4-4ac6-4adc-9c49-b1c0df9d5179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:21.864390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7565713-8dca-4010-ac2c-9300f37a69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:21.870627 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7565713-8dca-4010-ac2c-9300f37a69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1c598e-a460-4159-8729-da00b1a10224', 'volume_name': 'volume-df1c598e-a460-4159-8729-da00b1a10224', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:21.878355 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433cdf2e-9c59-47c9-a0b9-fddf8222a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:21.884175 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433cdf2e-9c59-47c9-a0b9-fddf8222a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:21.897074 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9ba6c5-92f0-4983-bd3e-57a723570700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:21.898797 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Volume df1c598e-a460-4159-8729-da00b1a10224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1c598e-a460-4159-8729-da00b1a10224', 'volume_size': 1} Jan 15 21:18:21.899383 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] creating volume 'volume-df1c598e-a460-4159-8729-da00b1a10224' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:18:21.901872 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:22.019062 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:22.019435 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:22.023233 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9ba6c5-92f0-4983-bd3e-57a723570700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1c598e-a460-4159-8729-da00b1a10224', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:22.029451 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6325570d-7495-47e9-8768-e32611b826bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:22.046125 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Volume volume-df1c598e-a460-4159-8729-da00b1a10224 (df1c598e-a460-4159-8729-da00b1a10224): created successfully Jan 15 21:18:22.050482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6325570d-7495-47e9-8768-e32611b826bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:22.062194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Flow 'volume_create_manager' (c86fb31b-d9d1-4797-8a77-96ba42ac4135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:22.088018 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-27dfc92f-e739-44d1-ab75-32422aa71512 tempest-GroupsTest-965852599 None] Created volume successfully. Jan 15 21:18:23.186429 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:23.192527 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:23.193445 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:23.218245 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Flow 'volume_create_manager' (50ca32ab-c123-4295-badf-f79bd0bf5b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:23.232326 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7348923-7453-4bf0-aa72-8597f9d24b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:23.240582 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:23.257728 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7348923-7453-4bf0-aa72-8597f9d24b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-672542159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dfd5fddc-7d02-4fbb-995b-cdc76f3b9acb,host='ncdv-master-1@ceph#ceph',id=9444877a-86ff-4e8d-8cbe-19feffbe1154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c0efe6af4849d6b69cfef20aecf802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:23Z,use_quota=True,user_id='b01c0d8165764b4a97189a09a9b7b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb0424e0-d4d6-45c4-bd17-ff46763fff08),volume_type_id=cb0424e0-d4d6-45c4-bd17-ff46763fff08)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:23.265229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1abf9cf-9f91-423b-8c42-244a165ebdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:23.270063 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1abf9cf-9f91-423b-8c42-244a165ebdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:23.276496 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfac684-6ca6-40cf-ac6b-05ba90e5f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:23.280757 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfac684-6ca6-40cf-ac6b-05ba90e5f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9444877a-86ff-4e8d-8cbe-19feffbe1154', 'volume_name': 'volume-9444877a-86ff-4e8d-8cbe-19feffbe1154', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:23.286775 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1ad384-386b-4774-9755-af7e434f94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:23.291646 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1ad384-386b-4774-9755-af7e434f94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:23.299309 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c117729-cec0-4cad-94ab-4d1e17b8b4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:23.306268 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Volume 9444877a-86ff-4e8d-8cbe-19feffbe1154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9444877a-86ff-4e8d-8cbe-19feffbe1154', 'volume_size': 1} Jan 15 21:18:23.306726 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] creating volume 'volume-9444877a-86ff-4e8d-8cbe-19feffbe1154' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:18:23.307715 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:23.429510 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:23.430202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:23.434202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c117729-cec0-4cad-94ab-4d1e17b8b4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9444877a-86ff-4e8d-8cbe-19feffbe1154', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:23.438811 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84acb5f7-7abd-40f5-a18b-47878ce03e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:23.453659 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Volume volume-9444877a-86ff-4e8d-8cbe-19feffbe1154 (9444877a-86ff-4e8d-8cbe-19feffbe1154): created successfully Jan 15 21:18:23.457585 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84acb5f7-7abd-40f5-a18b-47878ce03e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:23.466049 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Flow 'volume_create_manager' (50ca32ab-c123-4295-badf-f79bd0bf5b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:23.477369 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-dbb43ebf-a06a-4c6f-aac0-721a4d821522 tempest-GroupsTest-965852599 None] Created volume successfully. Jan 15 21:18:24.588815 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0b2de731-3600-4d4f-b9d7-fbb24b99573e tempest-GroupsTest-965852599 None] Update group completed successfully. Jan 15 21:18:25.960676 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-17bfd871-d119-40cb-95b1-d2afbb5e33fd tempest-GroupsTest-965852599 None] Update group completed successfully. Jan 15 21:18:27.489923 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:27.557803 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:18:27.558228 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Volume volume-9444877a-86ff-4e8d-8cbe-19feffbe1154 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:18:27.569944 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] deleting rbd volume volume-9444877a-86ff-4e8d-8cbe-19feffbe1154 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:18:27.924390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:28.021462 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:18:28.022021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Volume volume-df1c598e-a460-4159-8729-da00b1a10224 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:18:28.030425 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] deleting rbd volume volume-df1c598e-a460-4159-8729-da00b1a10224 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:18:28.474318 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Created reservations ['b6274fab-2b33-4310-aa7d-560f148da0f0'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:28.502644 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-209473599 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-209473599, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:28.504359 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-209473599 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-209473599, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:18:28.544078 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Created reservations ['4882f5ba-18a7-4d73-b4ed-2be2662409b4', 'b15388ac-99f5-47db-a1f8-95aa78e08e60', 'd555235e-635c-422f-8e0b-e70c69e78ea3', 'bffdebbd-a6ea-44cf-8ee3-f66416102614'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:28.720893 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Created reservations ['7a6b7914-5d70-4f36-a4f7-52080bd09675', '02a62f5a-9f44-4274-ba2e-0bfa5b6f1f1f', '83bb768d-7681-42b4-903a-0a1bffc95694', 'c00499ba-7c02-4c7d-a8bf-37646209e1b5'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:28.919665 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:29.009615 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:29.101119 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:29.107087 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-384367ad-8b1b-455d-b8d1-4b3420fa3644 tempest-GroupsTest-965852599 None] Delete group completed successfully. Jan 15 21:18:35.968633 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:35.971968 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:35.972419 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:36.010161 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (81d2595d-5f72-4c3f-a493-b44acaff66f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:36.025530 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b5b82b-455e-460c-a7e9-0665b66ef84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:36.039526 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:36.060766 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b5b82b-455e-460c-a7e9-0665b66ef84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1141628791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=091e0fee-5ffc-4d3e-84f0-350bf06feb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2ae6f05c2843469190cd96f39ac794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:36Z,use_quota=True,user_id='f0fc1955b0d446458f8f355550de971b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:36.067355 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4de658-61fb-4506-8f3b-2edbdb427d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:36.073469 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4de658-61fb-4506-8f3b-2edbdb427d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:36.079358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95b6fb-e3ba-417d-bb94-9d0ebba44d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:36.242314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95b6fb-e3ba-417d-bb94-9d0ebba44d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '091e0fee-5ffc-4d3e-84f0-350bf06feb4e', 'volume_name': 'volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:36.248415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67138ab4-b936-4732-94fd-e9b20bcc1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:36.259239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67138ab4-b936-4732-94fd-e9b20bcc1592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:36.276187 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdeae5c0-1d4f-4999-ae42-278b0915d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:36.277791 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Volume 091e0fee-5ffc-4d3e-84f0-350bf06feb4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:18:36.279356 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Cloning 091e0fee-5ffc-4d3e-84f0-350bf06feb4e from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:18:36.302128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:36.329344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 18, 36, 316697)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:18:36.329947 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:18:36.330384 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:18:36.336273 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.034s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:18:36.337829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:18:36.351401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 18, 36, 346067)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:18:36.353651 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:18:36.356221 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:18:36.385794 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:36.518432 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] creating snapshot='volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:18:37.038575 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e.clone_snap' to 'volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:18:37.113042 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:37.118027 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:37.119038 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:37.159652 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Flow 'volume_create_manager' (97abd38f-b230-4b80-868e-9f69040ebe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:37.171571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dd164e-a3e3-46d2-94d0-b22ff0c0bd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.181754 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:37.210337 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87dd164e-a3e3-46d2-94d0-b22ff0c0bd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-428959683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=50ec4519-e539-45ba-964f-cc02147ba888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b969d0b6b8e044ac89d22c14ec0e4c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:37Z,use_quota=True,user_id='afa20c5df47c4ad582771fa520a8c0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.218305 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc6f0c6-0092-4b31-8858-61dc1992f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.223530 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc6f0c6-0092-4b31-8858-61dc1992f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.232267 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99601729-2be4-47ae-8d5d-7892c03d9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.240130 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99601729-2be4-47ae-8d5d-7892c03d9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ec4519-e539-45ba-964f-cc02147ba888', 'volume_name': 'volume-50ec4519-e539-45ba-964f-cc02147ba888', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.248279 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64b3247-58df-4848-b7c8-b6fdee92bc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.264345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64b3247-58df-4848-b7c8-b6fdee92bc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.267535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b191b96-e3a9-4239-9f5a-eca92dd9a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.268673 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Volume 50ec4519-e539-45ba-964f-cc02147ba888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ec4519-e539-45ba-964f-cc02147ba888', 'volume_size': 1} Jan 15 21:18:37.269152 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] creating volume 'volume-50ec4519-e539-45ba-964f-cc02147ba888' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:18:37.270170 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:37.383099 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:18:37.385275 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:37.385754 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:37.415811 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:18:37.416528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Marking volume 091e0fee-5ffc-4d3e-84f0-350bf06feb4e as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:18:37.423804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:37.424268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:37.428330 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b191b96-e3a9-4239-9f5a-eca92dd9a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ec4519-e539-45ba-964f-cc02147ba888', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.433422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9332c192-c9aa-4d1a-962e-fab39d6e3e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.446222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 091e0fee-5ffc-4d3e-84f0-350bf06feb4e. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:18:37.447002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Creating volume glance metadata for volume 091e0fee-5ffc-4d3e-84f0-350bf06feb4e backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:18:37.450732 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Volume volume-50ec4519-e539-45ba-964f-cc02147ba888 (50ec4519-e539-45ba-964f-cc02147ba888): created successfully Jan 15 21:18:37.454517 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9332c192-c9aa-4d1a-962e-fab39d6e3e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.460190 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Flow 'volume_create_manager' (97abd38f-b230-4b80-868e-9f69040ebe8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:37.477358 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-42004605-daf1-4fcf-89c3-bc157235b01e tempest-SnapshotsActionsTest-339640300 None] Created volume successfully. Jan 15 21:18:37.522467 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdeae5c0-1d4f-4999-ae42-278b0915d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.529319 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3edb14-431d-4baa-aa2e-07bc4c2b58fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:37.539057 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Volume volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e (091e0fee-5ffc-4d3e-84f0-350bf06feb4e): created successfully Jan 15 21:18:37.543646 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3edb14-431d-4baa-aa2e-07bc4c2b58fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:37.550249 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (81d2595d-5f72-4c3f-a493-b44acaff66f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:37.562995 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d4d02f02-dbaa-46eb-92ab-6ae213b75346 tempest-TestVolumeBootPattern-1854138725 None] Created volume successfully. Jan 15 21:18:38.081540 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a9074f6c-4977-4f3a-8c49-99f103dc3483 tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:38.436441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c02d34b3-d4bb-41a6-85dd-337a2549f2e2 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:39.247269 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a9074f6c-4977-4f3a-8c49-99f103dc3483 tempest-SnapshotsActionsTest-339640300 None] Create snapshot completed successfully Jan 15 21:18:39.322730 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c02d34b3-d4bb-41a6-85dd-337a2549f2e2 tempest-TestVolumeBootPattern-1854138725 None] Create snapshot completed successfully Jan 15 21:18:40.952006 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-5a55ae40-a908-436d-b425-e151ffc9c1c7 tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:41.309310 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-5a55ae40-a908-436d-b425-e151ffc9c1c7 tempest-SnapshotsActionsTest-339640300 None] Create snapshot completed successfully Jan 15 21:18:41.327517 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:18:41.343241 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:41.430386 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:41.556161 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:42.275757 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4172e26b-2979-4b3e-9ff8-b7aeef4a8fe9 tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-2fdebf2d-2613-4056-b1c9-1dbc87b0c9ff-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.052s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:42.287177 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4172e26b-2979-4b3e-9ff8-b7aeef4a8fe9 tempest-SnapshotsActionsTest-694267798 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:43.329418 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-4172e26b-2979-4b3e-9ff8-b7aeef4a8fe9 tempest-SnapshotsActionsTest-694267798 None] Created reservations ['3f799357-d686-4d4f-8ed4-b1fc8f643b38', '5721d1f4-7dcd-4363-95ed-865a9e60eb61', 'b3816b4e-2059-474a-9785-a294eef0fcee', 'cc569bd1-aa58-4616-9f76-aa5b43858f73'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:43.420726 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4172e26b-2979-4b3e-9ff8-b7aeef4a8fe9 tempest-SnapshotsActionsTest-694267798 None] Delete snapshot completed successfully. Jan 15 21:18:43.426370 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-4172e26b-2979-4b3e-9ff8-b7aeef4a8fe9 tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-2fdebf2d-2613-4056-b1c9-1dbc87b0c9ff-delete_snapshot'" released by "delete_snapshot" :: held 1.151s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:18:44.050518 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:18:44.054634 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:18:44.056246 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:18:44.088469 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (ded1a2d2-c9fa-4c2a-a358-84dde84eb72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:44.095556 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c9b937-291b-4188-ad0b-2e213198b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:44.103608 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:18:44.123761 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c9b937-291b-4188-ad0b-2e213198b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:18:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb522678-195b-461c-8050-361be62c7b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2ae6f05c2843469190cd96f39ac794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=274cedd9-95a5-4b3a-a418-b81944457fed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:18:44Z,use_quota=True,user_id='f0fc1955b0d446458f8f355550de971b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:44.129636 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219ed10d-0add-4ae2-b775-398648e3a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:44.134632 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219ed10d-0add-4ae2-b775-398648e3a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:44.140101 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af19d41c-420e-4b45-b160-018e55a2d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:44.150866 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af19d41c-420e-4b45-b160-018e55a2d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb522678-195b-461c-8050-361be62c7b20', 'volume_name': 'volume-cb522678-195b-461c-8050-361be62c7b20', 'volume_size': 1, 'snapshot_id': '274cedd9-95a5-4b3a-a418-b81944457fed'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:44.156021 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132660b7-168b-4f72-b608-7538a923d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:44.160858 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132660b7-168b-4f72-b608-7538a923d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:44.165903 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fa20f2-65f6-4ae2-9f8b-9dfefc9b8ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:44.167201 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Volume cb522678-195b-461c-8050-361be62c7b20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb522678-195b-461c-8050-361be62c7b20', 'volume_size': 1, 'snapshot_id': '274cedd9-95a5-4b3a-a418-b81944457fed'} Jan 15 21:18:44.194388 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] cloning volumes/volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e@snapshot-274cedd9-95a5-4b3a-a418-b81944457fed to volume-cb522678-195b-461c-8050-361be62c7b20 {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:18:44.195303 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:44.288829 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:44.531481 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:18:44.532491 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:18:44.565623 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Marking volume cb522678-195b-461c-8050-361be62c7b20 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:18:44.587929 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Copying metadata from snapshot 274cedd9-95a5-4b3a-a418-b81944457fed to cb522678-195b-461c-8050-361be62c7b20. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 15 21:18:44.684147 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fa20f2-65f6-4ae2-9f8b-9dfefc9b8ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb522678-195b-461c-8050-361be62c7b20', 'volume_size': 1, 'snapshot_id': '274cedd9-95a5-4b3a-a418-b81944457fed'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:44.689523 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bf259f-8f84-4092-a647-e62af6b2b305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:18:44.702030 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Volume volume-cb522678-195b-461c-8050-361be62c7b20 (cb522678-195b-461c-8050-361be62c7b20): created successfully Jan 15 21:18:44.706975 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bf259f-8f84-4092-a647-e62af6b2b305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:18:44.715472 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (ded1a2d2-c9fa-4c2a-a358-84dde84eb72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:18:44.738567 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-4189149e-544e-4415-b8fc-3efdd49c7a3a tempest-TestVolumeBootPattern-1854138725 None] Created volume successfully. Jan 15 21:18:45.111290 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9e54434e-e357-480f-a404-5640591dd9eb tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:46.079515 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9e54434e-e357-480f-a404-5640591dd9eb tempest-SnapshotsActionsTest-339640300 None] Create snapshot completed successfully Jan 15 21:18:47.412397 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f49342a-b5ca-4cf8-9c05-dd3a256dcd33 tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-e17a2590-da4c-45d5-93f5-007eabb2e1c5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:47.420059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f49342a-b5ca-4cf8-9c05-dd3a256dcd33 tempest-SnapshotsActionsTest-694267798 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:47.635711 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-02cad151-26f4-42a9-8c9c-12bb159a1021 tempest-TestVolumeBootPattern-1854138725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:18:48.172660 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-9f49342a-b5ca-4cf8-9c05-dd3a256dcd33 tempest-SnapshotsActionsTest-694267798 None] Created reservations ['68f12395-1ef2-4dfd-87bd-649e206ab8ee', '61cce6ba-b3d8-4d47-ae58-519f76ed8c7f', 'efdca27d-b1f2-48a2-affe-1fd1fba122cb', 'f5298848-cc50-4e28-a3ac-fa78b686ebc6'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:48.267520 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f49342a-b5ca-4cf8-9c05-dd3a256dcd33 tempest-SnapshotsActionsTest-694267798 None] Delete snapshot completed successfully. Jan 15 21:18:48.278038 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f49342a-b5ca-4cf8-9c05-dd3a256dcd33 tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-e17a2590-da4c-45d5-93f5-007eabb2e1c5-delete_snapshot'" released by "delete_snapshot" :: held 0.867s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:18:49.139372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a86fb76d-3656-4cad-b44a-a3e45f3ea780 tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:49.239866 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-02cad151-26f4-42a9-8c9c-12bb159a1021 tempest-TestVolumeBootPattern-1854138725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.604s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:18:49.240482 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-02cad151-26f4-42a9-8c9c-12bb159a1021 tempest-TestVolumeBootPattern-1854138725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cb522678-195b-461c-8050-361be62c7b20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'cb522678-195b-461c-8050-361be62c7b20', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:18:49.283670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-02cad151-26f4-42a9-8c9c-12bb159a1021 tempest-TestVolumeBootPattern-1854138725 None] Connection info returned from driver {'name': 'volumes/volume-cb522678-195b-461c-8050-361be62c7b20', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cb522678-195b-461c-8050-361be62c7b20', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b53b7eb3-a439-4922-b3d7-425f6fb00f42'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:18:49.383585 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-7eae238e-4a52-483b-bd95-20d7fc30c5c6 req-02cad151-26f4-42a9-8c9c-12bb159a1021 tempest-TestVolumeBootPattern-1854138725 None] attachment_update completed successfully. Jan 15 21:18:50.167484 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a86fb76d-3656-4cad-b44a-a3e45f3ea780 tempest-SnapshotsActionsTest-339640300 None] Create snapshot completed successfully Jan 15 21:18:51.395795 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-40f32b1d-4a85-4880-9d00-036788588d4c tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-8fa171a2-70d5-4df0-9d16-d6013efd2580-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:51.402697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-40f32b1d-4a85-4880-9d00-036788588d4c tempest-SnapshotsActionsTest-694267798 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:52.228315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-40f32b1d-4a85-4880-9d00-036788588d4c tempest-SnapshotsActionsTest-694267798 None] Created reservations ['9533e9ca-0d6d-45c5-ab56-789dae27c773', '1fc88535-54c6-4b92-b7b7-36bbad4b3a35', 'a7862b55-115e-4137-ac64-bc21c089ece7', 'ff3b8567-7182-4178-a4ae-cd5f94616a44'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:52.282323 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-40f32b1d-4a85-4880-9d00-036788588d4c tempest-SnapshotsActionsTest-694267798 None] Delete snapshot completed successfully. Jan 15 21:18:52.288371 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-40f32b1d-4a85-4880-9d00-036788588d4c tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-8fa171a2-70d5-4df0-9d16-d6013efd2580-delete_snapshot'" released by "delete_snapshot" :: held 0.893s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:18:53.036217 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1e7f7920-3590-4fe5-b970-2c1d81406f23 tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:54.214013 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1e7f7920-3590-4fe5-b970-2c1d81406f23 tempest-SnapshotsActionsTest-339640300 None] Create snapshot completed successfully Jan 15 21:18:55.308444 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3ad601d9-5854-4eb9-91a2-d681aeda4974 tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-94a0cb66-aa38-4ef6-a487-011708fc5476-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:55.313451 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3ad601d9-5854-4eb9-91a2-d681aeda4974 tempest-SnapshotsActionsTest-694267798 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:56.293614 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-3ad601d9-5854-4eb9-91a2-d681aeda4974 tempest-SnapshotsActionsTest-694267798 None] Created reservations ['b4bd77f7-5e7c-4727-8890-534f38fc0fdf', 'dc6d5264-807a-4140-b9e3-c89a941773fb', '72eb149f-8774-4c2b-8be3-f92a55d86c73', 'e96fb524-4d5c-4f1b-a491-a8e2258508eb'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:56.380491 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3ad601d9-5854-4eb9-91a2-d681aeda4974 tempest-SnapshotsActionsTest-694267798 None] Delete snapshot completed successfully. Jan 15 21:18:56.389366 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-3ad601d9-5854-4eb9-91a2-d681aeda4974 tempest-SnapshotsActionsTest-694267798 None] Lock "b'cinder-94a0cb66-aa38-4ef6-a487-011708fc5476-delete_snapshot'" released by "delete_snapshot" :: held 1.081s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:18:57.019216 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7b15135b-9865-4a51-91a2-d1292e42b7e3 tempest-SnapshotsActionsTest-339640300 None] Lock "b'cinder-eb3780b5-13ab-4dd9-b230-450ec5b0fc4a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:57.021474 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7b15135b-9865-4a51-91a2-d1292e42b7e3 tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:58.235661 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-7b15135b-9865-4a51-91a2-d1292e42b7e3 tempest-SnapshotsActionsTest-339640300 None] Created reservations ['59af2da5-aa85-4886-8c08-98de5a02fd0d', 'dca7940b-328d-4e1c-854f-4b34eeebacc6', '33c38977-bef4-4a26-b16f-9696f9161d66', '1ecbfd2c-5a7d-405f-b788-54c88c50b738'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:58.274670 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7b15135b-9865-4a51-91a2-d1292e42b7e3 tempest-SnapshotsActionsTest-339640300 None] Delete snapshot completed successfully. Jan 15 21:18:58.289637 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7b15135b-9865-4a51-91a2-d1292e42b7e3 tempest-SnapshotsActionsTest-339640300 None] Lock "b'cinder-eb3780b5-13ab-4dd9-b230-450ec5b0fc4a-delete_snapshot'" released by "delete_snapshot" :: held 1.270s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:18:59.189594 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] Lock "b'cinder-50ec4519-e539-45ba-964f-cc02147ba888-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:18:59.251293 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:59.314643 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:18:59.315097 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] Volume volume-50ec4519-e539-45ba-964f-cc02147ba888 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:18:59.329146 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] deleting rbd volume volume-50ec4519-e539-45ba-964f-cc02147ba888 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:18:59.676046 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] Created reservations ['1c7820ae-2145-444a-8ca3-21c052d33275', '6ff8be1c-508d-4b4f-8ab2-d7c1925c4963', '99006a64-ae0b-4226-832b-4a35501cc81c', 'f9f906fe-38d6-4cd8-aeb6-448ef0a2409b'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:18:59.746931 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:59.814800 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:18:59.871082 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:18:59.875420 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] Deleted volume successfully. Jan 15 21:18:59.893460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-406429f7-2955-42a8-9aa1-1a65cafd504f tempest-SnapshotsActionsTest-339640300 None] Lock "b'cinder-50ec4519-e539-45ba-964f-cc02147ba888-delete_volume'" released by "delete_volume" :: held 0.704s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:04.711703 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-429179c4-8d60-4f3d-9878-956a57252ecd tempest-TestVolumeBootPattern-1854138725 None] Terminate volume connection completed successfully. Jan 15 21:19:04.712924 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-429179c4-8d60-4f3d-9878-956a57252ecd tempest-TestVolumeBootPattern-1854138725 None] Deleting attachment b53b7eb3-a439-4922-b3d7-425f6fb00f42. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:19:05.005261 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-cb522678-195b-461c-8050-361be62c7b20-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:05.099634 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:05.310310 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:05.323195 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] deleting rbd volume volume-cb522678-195b-461c-8050-361be62c7b20 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:05.735109 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['8fe28dd5-016d-488d-a3a9-ecf9c055b2f1', '1e0001d6-df2d-4912-987e-47f02a8fbb63', '4941a9a0-a1bd-479d-a5f2-5081409490ca', 'a73cfacb-1910-465e-96e5-889f40c3b779'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:05.813388 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:05.878663 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:05.963281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:05.973106 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] Deleted volume successfully. Jan 15 21:19:05.993306 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-5f8fe8bc-f353-4024-9981-e06d3f7810a3 req-bc9b9cfc-a02b-479a-b9ea-fdde878a9560 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-cb522678-195b-461c-8050-361be62c7b20-delete_volume'" released by "delete_volume" :: held 0.992s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:07.800794 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a615480d-bc97-4d12-9953-9284a6628be6 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-274cedd9-95a5-4b3a-a418-b81944457fed-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.027s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:07.814225 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a615480d-bc97-4d12-9953-9284a6628be6 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:08.499314 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a615480d-bc97-4d12-9953-9284a6628be6 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['11275e39-a319-41e3-b0ca-49de599887d5', '1d9857bd-17e0-4667-93e9-e116757a7af6', 'e16dbaff-9e56-4a03-b983-ccfbe850c90d', '6c8d2387-d414-4bf0-b5b1-e13f78a68fd8'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:08.589528 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a615480d-bc97-4d12-9953-9284a6628be6 tempest-TestVolumeBootPattern-1854138725 None] Delete snapshot completed successfully. Jan 15 21:19:08.596288 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a615480d-bc97-4d12-9953-9284a6628be6 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-274cedd9-95a5-4b3a-a418-b81944457fed-delete_snapshot'" released by "delete_snapshot" :: held 0.795s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:09.045708 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-091e0fee-5ffc-4d3e-84f0-350bf06feb4e-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:09.112121 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:09.249935 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:09.260385 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] deleting rbd volume volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:09.687022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:19:09.735550 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] deleting parent snapshot volume-091e0fee-5ffc-4d3e-84f0-350bf06feb4e.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:19:10.591156 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['de17f1e7-63d1-4f30-aa92-f2b724926cb3', '47625c37-18a5-4087-8678-ca38f3a1d746', 'e51e8f8d-4e53-41ed-ab35-847fda95565f', '50abd62e-3f17-4d67-b2cb-0ea3a6a08881'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:10.728495 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:10.844270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:10.956108 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:10.967102 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] Deleted volume successfully. Jan 15 21:19:11.005616 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a4f666e5-3e2e-45b9-83cc-6627d7d4674d tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-091e0fee-5ffc-4d3e-84f0-350bf06feb4e-delete_volume'" released by "delete_volume" :: held 1.966s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:12.254174 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:19:12.261973 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:19:12.262454 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:19:12.297488 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (e9d2e84b-b3c6-48a7-8e30-6843095d9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:12.307591 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133131af-3768-4e9b-9979-27f2e5740ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:12.318326 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:19:12.340787 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133131af-3768-4e9b-9979-27f2e5740ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-679970912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5a60bb93-fa3d-4edd-92d3-808762b016b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2ae6f05c2843469190cd96f39ac794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:19:12Z,use_quota=True,user_id='f0fc1955b0d446458f8f355550de971b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:12.347813 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb23bbe-b095-4c97-b58a-45240a8f1ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:12.371521 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb23bbe-b095-4c97-b58a-45240a8f1ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:12.378215 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8c400d-2da9-4433-9494-3c3384f38e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:12.541027 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8c400d-2da9-4433-9494-3c3384f38e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a60bb93-fa3d-4edd-92d3-808762b016b9', 'volume_name': 'volume-5a60bb93-fa3d-4edd-92d3-808762b016b9', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:12.551042 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5107ef-0230-41c9-b348-c680d84228ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:12.561208 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5107ef-0230-41c9-b348-c680d84228ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:12.574486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8be8f4-7954-46f4-9147-1637bc9e65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:12.578505 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Volume 5a60bb93-fa3d-4edd-92d3-808762b016b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a60bb93-fa3d-4edd-92d3-808762b016b9', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:19:12.580318 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Cloning 5a60bb93-fa3d-4edd-92d3-808762b016b9 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:19:12.598895 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:12.621420 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 19, 12, 611513)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:19:12.622135 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:19:12.622764 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:19:12.636374 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.038s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:12.637566 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:19:12.644546 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 19, 12, 641299)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:19:12.647938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:19:12.649401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:19:12.667102 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:12.777304 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] creating snapshot='volume-5a60bb93-fa3d-4edd-92d3-808762b016b9.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:19:13.543508 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-5a60bb93-fa3d-4edd-92d3-808762b016b9.clone_snap' to 'volume-5a60bb93-fa3d-4edd-92d3-808762b016b9' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:19:13.760519 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:13.761604 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:13.762150 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:13.807311 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:19:13.808171 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Marking volume 5a60bb93-fa3d-4edd-92d3-808762b016b9 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:19:13.836098 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 5a60bb93-fa3d-4edd-92d3-808762b016b9. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:19:13.837045 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Creating volume glance metadata for volume 5a60bb93-fa3d-4edd-92d3-808762b016b9 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:19:13.939538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8be8f4-7954-46f4-9147-1637bc9e65c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a60bb93-fa3d-4edd-92d3-808762b016b9', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:13.945184 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08223c9-8d46-43f7-b657-13c7ced03234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:13.972610 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Volume volume-5a60bb93-fa3d-4edd-92d3-808762b016b9 (5a60bb93-fa3d-4edd-92d3-808762b016b9): created successfully Jan 15 21:19:13.977219 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08223c9-8d46-43f7-b657-13c7ced03234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:13.990593 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (e9d2e84b-b3c6-48a7-8e30-6843095d9a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:14.006999 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8f39a153-a6c3-42bb-9160-2c81374e9ab2 tempest-TestVolumeBootPattern-1854138725 None] Created volume successfully. Jan 15 21:19:18.447995 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-6fe9a3e1-749b-41e8-8674-9220e7a11669 req-7e3e01f4-4f17-4765-8fe8-1d21ae046722 tempest-TestVolumeBootPattern-1854138725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:19:18.938647 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:19:18.947466 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:19:18.948361 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:19:18.973587 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Flow 'volume_create_manager' (d2baafb5-2ae0-4130-b40f-3a55a4aebf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:18.981281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fda5273-044a-4550-9fd3-b602711086ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:18.989404 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:19:19.017697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fda5273-044a-4550-9fd3-b602711086ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1555800913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3db41434-9a6d-49bc-89ec-404ceb8f221a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9228ff553141909e749dfda99fbc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:19:19Z,use_quota=True,user_id='2de3e7879a36415ca16e3cd4de5b30d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:19.025808 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a2d51e-b7bd-4eb7-a1bf-b7c40eb91137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:19.031058 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a2d51e-b7bd-4eb7-a1bf-b7c40eb91137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:19.037568 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e33bc7b-23a8-4346-a039-8e2429e75b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:19.043914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e33bc7b-23a8-4346-a039-8e2429e75b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db41434-9a6d-49bc-89ec-404ceb8f221a', 'volume_name': 'volume-3db41434-9a6d-49bc-89ec-404ceb8f221a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:19.059755 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f12dee9-f97d-46ba-befd-8dbb2266ac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:19.068353 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f12dee9-f97d-46ba-befd-8dbb2266ac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:19.073892 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d07af66-50b2-47ea-9a69-e1086caa0d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:19.075283 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Volume 3db41434-9a6d-49bc-89ec-404ceb8f221a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db41434-9a6d-49bc-89ec-404ceb8f221a', 'volume_size': 1} Jan 15 21:19:19.075706 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] creating volume 'volume-3db41434-9a6d-49bc-89ec-404ceb8f221a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:19:19.080205 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:19.232204 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:19.232586 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:19.249176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d07af66-50b2-47ea-9a69-e1086caa0d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db41434-9a6d-49bc-89ec-404ceb8f221a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:19.254873 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638113a1-e906-420f-bc3a-7eb852652566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:19.275273 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Volume volume-3db41434-9a6d-49bc-89ec-404ceb8f221a (3db41434-9a6d-49bc-89ec-404ceb8f221a): created successfully Jan 15 21:19:19.278477 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638113a1-e906-420f-bc3a-7eb852652566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:19.284491 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Flow 'volume_create_manager' (d2baafb5-2ae0-4130-b40f-3a55a4aebf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:19.299277 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-965f4479-6be7-4c38-8829-ef65ff02a80f tempest-VolumesDeleteCascade-877903340 None] Created volume successfully. Jan 15 21:19:19.409429 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-6fe9a3e1-749b-41e8-8674-9220e7a11669 req-7e3e01f4-4f17-4765-8fe8-1d21ae046722 tempest-TestVolumeBootPattern-1854138725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.961s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:19:19.410380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6fe9a3e1-749b-41e8-8674-9220e7a11669 req-7e3e01f4-4f17-4765-8fe8-1d21ae046722 tempest-TestVolumeBootPattern-1854138725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5a60bb93-fa3d-4edd-92d3-808762b016b9', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '5a60bb93-fa3d-4edd-92d3-808762b016b9', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:19:19.442092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6fe9a3e1-749b-41e8-8674-9220e7a11669 req-7e3e01f4-4f17-4765-8fe8-1d21ae046722 tempest-TestVolumeBootPattern-1854138725 None] Connection info returned from driver {'name': 'volumes/volume-5a60bb93-fa3d-4edd-92d3-808762b016b9', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5a60bb93-fa3d-4edd-92d3-808762b016b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '54611ed6-ec3a-4fca-a33f-a72aaa96e9ae'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:19:19.507108 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-6fe9a3e1-749b-41e8-8674-9220e7a11669 req-7e3e01f4-4f17-4765-8fe8-1d21ae046722 tempest-TestVolumeBootPattern-1854138725 None] attachment_update completed successfully. Jan 15 21:19:20.227514 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-85ee98cd-973d-4a9d-9938-6b37377cf09e tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:21.213265 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-85ee98cd-973d-4a9d-9938-6b37377cf09e tempest-VolumesDeleteCascade-877903340 None] Create snapshot completed successfully Jan 15 21:19:22.532889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-186aa912-65d3-446a-a019-a8002bc084e0 tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:22.618380 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b43b3b83-92ec-4ca5-8514-9b139d12040c tempest-GroupsV314Test-404442014 None] Group tempest-GroupsV314Test-Group-868816547: creating Jan 15 21:19:22.645886 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b43b3b83-92ec-4ca5-8514-9b139d12040c tempest-GroupsV314Test-404442014 None] Group tempest-GroupsV314Test-Group-868816547: created successfully Jan 15 21:19:22.659238 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b43b3b83-92ec-4ca5-8514-9b139d12040c tempest-GroupsV314Test-404442014 None] Create group completed successfully. Jan 15 21:19:23.133509 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-186aa912-65d3-446a-a019-a8002bc084e0 tempest-VolumesDeleteCascade-877903340 None] Create snapshot completed successfully Jan 15 21:19:23.598527 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Lock "b'cinder-3db41434-9a6d-49bc-89ec-404ceb8f221a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:23.634117 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Performing cascade delete. {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Jan 15 21:19:23.651256 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Lock "b'cinder-6e887ee7-494e-4527-8a7d-2a10d02ee42a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:23.664193 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:24.014438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:19:24.018924 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:19:24.020215 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:19:24.044287 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Flow 'volume_create_manager' (73fb8908-7dbb-4ff0-8ca0-03c6e07a04b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:24.051317 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b51594b-f91a-4e8d-8710-eb846a5c495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:24.063553 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:19:24.083041 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b51594b-f91a-4e8d-8710-eb846a5c495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-980194463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=26b334e7-eea8-44d8-9546-4c63d7d182f2,host='ncdv-master-1@ceph#ceph',id=0cac560e-b7ee-4d19-acbd-761391b325bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850ed43f8be7442e91b9543290f2aef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:19:24Z,use_quota=True,user_id='c790d8705c904db19aeb70dc10ac4928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea7e14fd-a5c2-4d23-b72d-ccb7c9ee5481),volume_type_id=ea7e14fd-a5c2-4d23-b72d-ccb7c9ee5481)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:24.094345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc258e1-bb5b-47eb-a3cf-a07f980ee89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:24.099268 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc258e1-bb5b-47eb-a3cf-a07f980ee89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:24.105513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507cc9d0-0163-4b68-b21a-241d3abae922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:24.110221 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507cc9d0-0163-4b68-b21a-241d3abae922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cac560e-b7ee-4d19-acbd-761391b325bf', 'volume_name': 'volume-0cac560e-b7ee-4d19-acbd-761391b325bf', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:24.115263 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa2e21-af24-40b7-93f7-584eff547fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:24.120181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa2e21-af24-40b7-93f7-584eff547fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:24.124966 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a0eba6-9d1e-485b-a8f4-d6bc72ab6013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:24.126104 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Volume 0cac560e-b7ee-4d19-acbd-761391b325bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cac560e-b7ee-4d19-acbd-761391b325bf', 'volume_size': 1} Jan 15 21:19:24.126497 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] creating volume 'volume-0cac560e-b7ee-4d19-acbd-761391b325bf' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:19:24.127479 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:24.206388 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:24.207054 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:24.211391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a0eba6-9d1e-485b-a8f4-d6bc72ab6013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cac560e-b7ee-4d19-acbd-761391b325bf', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:24.216593 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d33dd89-8ead-4773-b458-2dfa1da702a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:24.235783 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Volume volume-0cac560e-b7ee-4d19-acbd-761391b325bf (0cac560e-b7ee-4d19-acbd-761391b325bf): created successfully Jan 15 21:19:24.239563 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d33dd89-8ead-4773-b458-2dfa1da702a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:24.246091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Flow 'volume_create_manager' (73fb8908-7dbb-4ff0-8ca0-03c6e07a04b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:24.260402 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a7e957da-a4e6-420d-9e51-008386052044 tempest-GroupsV314Test-404442014 None] Created volume successfully. Jan 15 21:19:24.275172 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Created reservations ['f1cfa2d7-adc5-4820-81ee-975a29021ddb', 'fe2f5109-0168-4f4d-bd57-134918c139c6', 'a8cb5d68-70df-4b12-a354-bab8a5039d17', '90932f95-3c06-47ca-8999-1ad4c4a25e68'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:24.312359 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Delete snapshot completed successfully. Jan 15 21:19:24.316730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Lock "b'cinder-6e887ee7-494e-4527-8a7d-2a10d02ee42a-delete_snapshot'" released by "delete_snapshot" :: held 0.666s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:24.324762 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Lock "b'cinder-f6bc93eb-6db9-447d-a2f8-9e6df083a6ed-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:24.338067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:25.220370 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Created reservations ['a1d0cd37-ec10-48f6-9f48-864c11e81156', '86d61a1c-b549-4c4b-b531-faf1f6ecb502', '12ebc1e0-40b3-41fb-bf2d-ca8d21be1535', '10bc97e1-c626-4518-b745-55c1cf0ce2a1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:25.281346 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Delete snapshot completed successfully. Jan 15 21:19:25.288454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Lock "b'cinder-f6bc93eb-6db9-447d-a2f8-9e6df083a6ed-delete_snapshot'" released by "delete_snapshot" :: held 0.963s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:25.290461 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Snapshots deleted, issuing volume delete {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Jan 15 21:19:25.291893 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:25.360422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:25.361342 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Volume volume-3db41434-9a6d-49bc-89ec-404ceb8f221a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:25.369437 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] deleting rbd volume volume-3db41434-9a6d-49bc-89ec-404ceb8f221a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:25.641621 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:25.698103 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] creating snapshot='volume-d2eb44bb-4650-49a2-8c68-a59abf1f2ca9.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:19:26.152974 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] cloning 'volume-0cac560e-b7ee-4d19-acbd-761391b325bf@volume-d2eb44bb-4650-49a2-8c68-a59abf1f2ca9.clone_snap' to 'volume-d2eb44bb-4650-49a2-8c68-a59abf1f2ca9' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:19:26.207963 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Created reservations ['187f5318-5e6d-446c-8b5c-7d97026a8dde', 'fd9f8068-4fa4-44ed-b358-762f67cc8f02', 'ecef4797-5943-496c-a4be-ad48a6c589b0', '37b4e9b5-464f-4a5a-90ce-8ce20ebdd926'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:26.276255 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:26.348079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:26.407914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:26.436427 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] Volume volume-0cac560e-b7ee-4d19-acbd-761391b325bf is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:26.442204 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Deleted volume successfully. Jan 15 21:19:26.446013 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:26.446338 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:26.470998 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:19:26.492576 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-56290b90-9e9a-4b0c-bc1c-a2ef964e3cc3 tempest-VolumesDeleteCascade-877903340 None] Lock "b'cinder-3db41434-9a6d-49bc-89ec-404ceb8f221a-delete_volume'" released by "delete_volume" :: held 2.894s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:26.548527 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6e8f0367-5c05-4143-858b-d38b43ddd10c tempest-GroupsV314Test-404442014 None] Create group from source-group-26b334e7-eea8-44d8-9546-4c63d7d182f2 completed successfully. Jan 15 21:19:27.416751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:27.538438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:27.551346 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] deleting rbd volume volume-d2eb44bb-4650-49a2-8c68-a59abf1f2ca9 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:27.932189 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:19:27.963377 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Volume volume-0cac560e-b7ee-4d19-acbd-761391b325bf is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:27.964020 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] deleting parent snapshot volume-d2eb44bb-4650-49a2-8c68-a59abf1f2ca9.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:19:28.278399 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Created reservations ['20313ec8-e167-4d2d-b86f-5df2e9710652'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:28.305616 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1242954973 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1242954973, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:19:28.306419 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1242954973 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1242954973, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:19:28.324283 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Created reservations ['a684877b-558e-43ea-b936-426d681ea4ed', 'a849210b-9ab4-4275-b8ca-0c172ca4f7be', '1f1e3ff2-7b15-43b0-b9bc-f3917cce05f6', '228cd12a-7d57-4b97-b968-ac756c00be53'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:28.470573 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:28.564740 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:28.640824 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:28.645332 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-29f096c3-3733-423f-b4ab-48abe7adc1c3 tempest-GroupsV314Test-404442014 None] Delete group completed successfully. Jan 15 21:19:28.935661 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:29.057563 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:29.057563 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] Volume volume-0cac560e-b7ee-4d19-acbd-761391b325bf is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:29.067084 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] deleting rbd volume volume-0cac560e-b7ee-4d19-acbd-761391b325bf {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:29.492446 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] Created reservations ['9ac9e42a-cd6e-404c-8472-ad546f8e72ae'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:29.539769 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] Created reservations ['e7637e8f-28d2-4707-9cb2-5d4e0676b9c4', 'e6e7ecec-77dd-4fa7-b3ec-94c2435e2778', '5fecebb4-8241-402e-94c0-d2de7cf1b371', 'd586dfeb-2e22-47b2-91c8-56b543fbce70'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:29.759765 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:29.820902 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:29.891858 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:29.904388 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c9443f2f-3ad1-4a90-92ae-2cb5672175b6 tempest-GroupsV314Test-404442014 None] Delete group completed successfully. Jan 15 21:19:30.356121 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:19:30.364925 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:19:30.365965 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:19:30.396024 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Flow 'volume_create_manager' (d07229f7-320a-4c1c-bc04-f434cae82ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:30.403589 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd3dfbd-1670-48b5-8570-fbb7ebac9522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:30.411141 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:19:30.438203 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd3dfbd-1670-48b5-8570-fbb7ebac9522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1897742005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d62692a-94e4-40f2-aee4-6e224e251c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0551003f0e064b63b558f7eafc9aa762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:19:30Z,use_quota=True,user_id='ef9056bfe95a4c02b4de21cce394929c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:30.447035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b758e002-555d-4582-9cc2-82cadf2dc7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:30.451851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b758e002-555d-4582-9cc2-82cadf2dc7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:30.457311 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd57982-2283-437f-bbdc-61dd6e7e04af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:30.462714 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd57982-2283-437f-bbdc-61dd6e7e04af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d62692a-94e4-40f2-aee4-6e224e251c3c', 'volume_name': 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:30.471264 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca7e8eb-7106-4c58-b80c-0b63c3fc094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:30.477842 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca7e8eb-7106-4c58-b80c-0b63c3fc094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:30.483483 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8017c17-0a2a-45a3-a64e-e3b43cbe55c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:30.484794 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Volume 9d62692a-94e4-40f2-aee4-6e224e251c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c', 'volume_size': 1} Jan 15 21:19:30.485222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] creating volume 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:19:30.486229 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:30.581185 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:30.581770 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:30.586230 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8017c17-0a2a-45a3-a64e-e3b43cbe55c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d62692a-94e4-40f2-aee4-6e224e251c3c', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:30.591634 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea68029-1346-49c7-9bc0-13955dd3d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:30.604142 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Volume volume-9d62692a-94e4-40f2-aee4-6e224e251c3c (9d62692a-94e4-40f2-aee4-6e224e251c3c): created successfully Jan 15 21:19:30.609662 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea68029-1346-49c7-9bc0-13955dd3d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:30.617670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Flow 'volume_create_manager' (d07229f7-320a-4c1c-bc04-f434cae82ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:30.636517 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-3dcd029b-973f-4d12-a2a0-9282bb7e1290 tempest-VolumesBackupsV39Test-1693006658 None] Created volume successfully. Jan 15 21:19:31.753376 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:19:31.902846 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-b9913d06-f56d-48a4-b151-78a39c033506 req-10648fd5-73cf-44b9-974d-e6352c6920a8 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:32.551580 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-b9913d06-f56d-48a4-b151-78a39c033506 req-10648fd5-73cf-44b9-974d-e6352c6920a8 tempest-TestVolumeBootPattern-1854138725 None] Create snapshot completed successfully Jan 15 21:19:32.670290 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.917s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:19:32.672110 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9d62692a-94e4-40f2-aee4-6e224e251c3c', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '9d62692a-94e4-40f2-aee4-6e224e251c3c', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:19:32.689015 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Initialize volume connection completed successfully. Jan 15 21:19:34.651725 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Terminate volume connection completed successfully. Jan 15 21:19:34.678645 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-6e3b1ce9-80de-41d3-828e-c084939cc30e tempest-VolumesBackupsV39Test-1693006658 None] Remove volume export completed successfully. Jan 15 21:19:34.780228 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8a9880d1-4cc1-44e9-ba71-d09fc521fe3c tempest-GroupsV320Test-320231536 None] Group tempest-GroupsV320Test-Group-1518683742: creating Jan 15 21:19:34.798148 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8a9880d1-4cc1-44e9-ba71-d09fc521fe3c tempest-GroupsV320Test-320231536 None] Group tempest-GroupsV320Test-Group-1518683742: created successfully Jan 15 21:19:34.808448 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-8a9880d1-4cc1-44e9-ba71-d09fc521fe3c tempest-GroupsV320Test-320231536 None] Create group completed successfully. Jan 15 21:19:35.714705 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:19:35.720593 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:19:35.721392 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:19:35.759328 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (727d4410-ed98-4bb0-b0e3-393593f6f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:35.768601 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fea1a14-e2b2-48dc-8e24-61f4bdcc310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:35.777913 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:19:35.799020 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fea1a14-e2b2-48dc-8e24-61f4bdcc310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:19:35Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2ae6f05c2843469190cd96f39ac794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=773cf368-b8b6-44db-9909-9b312ca3b6bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:19:36Z,use_quota=True,user_id='f0fc1955b0d446458f8f355550de971b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:35.808376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82593ce3-75b8-4905-a904-8d7ba5697490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:35.817808 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82593ce3-75b8-4905-a904-8d7ba5697490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:35.831096 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc147fc-e2d2-464d-9ce2-2babc58deffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:35.836234 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc147fc-e2d2-464d-9ce2-2babc58deffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'volume_name': 'volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'volume_size': 1, 'snapshot_id': '773cf368-b8b6-44db-9909-9b312ca3b6bc'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:35.842683 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95d4da0-a753-43f9-bbab-13189b369c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:35.848233 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95d4da0-a753-43f9-bbab-13189b369c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:35.854588 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb63fd8c-d620-4724-a17c-93a3af6e9e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:35.855655 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Volume 5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'volume_size': 1, 'snapshot_id': '773cf368-b8b6-44db-9909-9b312ca3b6bc'} Jan 15 21:19:35.900223 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] cloning volumes/volume-5a60bb93-fa3d-4edd-92d3-808762b016b9@snapshot-773cf368-b8b6-44db-9909-9b312ca3b6bc to volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:19:35.903434 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:36.049945 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:36.316618 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:36.317030 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:36.346610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Marking volume 5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:19:36.361973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Copying metadata from snapshot 773cf368-b8b6-44db-9909-9b312ca3b6bc to 5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 15 21:19:36.421532 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb63fd8c-d620-4724-a17c-93a3af6e9e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'volume_size': 1, 'snapshot_id': '773cf368-b8b6-44db-9909-9b312ca3b6bc'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:36.428052 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101d4ec7-1486-4cd7-87ba-74daf4edb2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:36.442337 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Volume volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba (5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba): created successfully Jan 15 21:19:36.447003 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101d4ec7-1486-4cd7-87ba-74daf4edb2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:36.452808 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (727d4410-ed98-4bb0-b0e3-393593f6f582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:36.472630 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-45217353-adbd-4782-bbf8-1bb57e5dfa76 tempest-TestVolumeBootPattern-1854138725 None] Created volume successfully. Jan 15 21:19:36.579091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-4052c177-a349-49cc-ad6a-65514955eaea tempest-GroupsV320Test-320231536 None] Created reservations ['77329d27-c5ec-4022-b117-941d21ba649f'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:36.614943 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4052c177-a349-49cc-ad6a-65514955eaea tempest-GroupsV320Test-320231536 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:36.640568 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-4052c177-a349-49cc-ad6a-65514955eaea tempest-GroupsV320Test-320231536 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:36.672429 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-4052c177-a349-49cc-ad6a-65514955eaea tempest-GroupsV320Test-320231536 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:36.678437 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-4052c177-a349-49cc-ad6a-65514955eaea tempest-GroupsV320Test-320231536 None] Delete group completed successfully. Jan 15 21:19:38.233975 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] Lock "b'cinder-9d62692a-94e4-40f2-aee4-6e224e251c3c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:38.270000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:39.110489 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] Volume volume-9d62692a-94e4-40f2-aee4-6e224e251c3c is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:39.128149 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] deleting rbd volume volume-9d62692a-94e4-40f2-aee4-6e224e251c3c {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:39.149627 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-7b9cdcc7-c39f-4d93-9488-ac1a4a44590e tempest-TestVolumeBootPattern-1854138725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:19:39.430856 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] Created reservations ['7202b757-dba2-4281-b9d9-d54357dfc780', '70ea5e36-2be7-4a3f-af60-687a0c426115', '710d8ebc-ecc1-46f1-971e-14151b4fb0e2', '02d16c69-34c1-4934-a70f-5b4a19ac316e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:39.500449 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:39.592339 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:39.668915 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:39.682161 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] Deleted volume successfully. Jan 15 21:19:39.700205 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0cc14166-1bf5-44d8-967f-1eebc8c07e11 tempest-VolumesBackupsV39Test-1693006658 None] Lock "b'cinder-9d62692a-94e4-40f2-aee4-6e224e251c3c-delete_volume'" released by "delete_volume" :: held 1.466s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:39.951654 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-7b9cdcc7-c39f-4d93-9488-ac1a4a44590e tempest-TestVolumeBootPattern-1854138725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.802s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:19:39.952311 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-7b9cdcc7-c39f-4d93-9488-ac1a4a44590e tempest-TestVolumeBootPattern-1854138725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:19:39.975692 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-7b9cdcc7-c39f-4d93-9488-ac1a4a44590e tempest-TestVolumeBootPattern-1854138725 None] Connection info returned from driver {'name': 'volumes/volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '04d48245-9c3a-438d-803f-24014184a99d'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:19:40.051696 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-6005084a-cbc9-4ee8-b5d4-e504e7518abc req-7b9cdcc7-c39f-4d93-9488-ac1a4a44590e tempest-TestVolumeBootPattern-1854138725 None] attachment_update completed successfully. Jan 15 21:19:41.325407 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:19:41.335661 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:41.425365 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:41.493689 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:48.774909 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:19:48.780808 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:19:48.780808 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:19:48.801156 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Flow 'volume_create_manager' (ee7941d5-8f1d-4310-88e8-499a0e26db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:48.808887 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f0fe5e-0503-4bf8-9a96-eadbc983c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:48.816531 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:19:48.834300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f0fe5e-0503-4bf8-9a96-eadbc983c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-927352447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6eb64d4d-cc92-485c-af99-78fc28a8b45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f56206cdde54071af9dc79ae3183599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:19:49Z,use_quota=True,user_id='a03caca3dcf24f6998c859d749c2d44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51022aa0-b308-48a1-911b-9b642e199d59),volume_type_id=51022aa0-b308-48a1-911b-9b642e199d59)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:48.840541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db094621-4d0e-41df-a0d0-16ce2e8f74b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:48.845089 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db094621-4d0e-41df-a0d0-16ce2e8f74b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:48.850849 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520bcead-dc23-408a-aec7-7ed54b70468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:48.855372 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520bcead-dc23-408a-aec7-7ed54b70468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb64d4d-cc92-485c-af99-78fc28a8b45b', 'volume_name': 'volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:48.860692 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451ba03c-b446-4830-9254-11d390ea44b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:48.864965 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451ba03c-b446-4830-9254-11d390ea44b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:48.870982 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bea1788-e5d4-4ff9-b915-b99bfa27e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:48.872539 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Volume 6eb64d4d-cc92-485c-af99-78fc28a8b45b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b', 'volume_size': 1} Jan 15 21:19:48.873222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] creating volume 'volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:19:48.874250 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:48.939847 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] extra_specs: {} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:19:48.940262 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] extra_specs: {} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:19:48.945414 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bea1788-e5d4-4ff9-b915-b99bfa27e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:48.950980 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42695aff-9799-4bd8-9b82-02b7213fde68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:19:48.962444 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Volume volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b (6eb64d4d-cc92-485c-af99-78fc28a8b45b): created successfully Jan 15 21:19:48.966209 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42695aff-9799-4bd8-9b82-02b7213fde68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:19:48.971873 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Flow 'volume_create_manager' (ee7941d5-8f1d-4310-88e8-499a0e26db65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:19:48.979339 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-1ff73726-7444-4f0f-864c-d04bbd4983be tempest-VolumeTypesAccessTest-1434218405 None] Created volume successfully. Jan 15 21:19:50.115332 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Lock "b'cinder-6eb64d4d-cc92-485c-af99-78fc28a8b45b-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:50.148100 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:50.192641 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:50.193727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Volume volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:19:50.202801 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] deleting rbd volume volume-6eb64d4d-cc92-485c-af99-78fc28a8b45b {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:50.543164 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-15105004-0632-4dce-a1bb-b74c713c1cac tempest-TestVolumeBootPattern-1854138725 None] Terminate volume connection completed successfully. Jan 15 21:19:50.543851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-15105004-0632-4dce-a1bb-b74c713c1cac tempest-TestVolumeBootPattern-1854138725 None] Deleting attachment 04d48245-9c3a-438d-803f-24014184a99d. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:19:50.576684 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-115064271 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-115064271, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:19:50.577555 ncdv-master-1 cinder-volume[122725]: WARNING cinder.quota [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-115064271 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-115064271, it is now deprecated. Please use the default quota class for default quota. Jan 15 21:19:50.612233 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Created reservations ['cfd13cfb-64a2-4397-b75e-91ebcdd9613a', 'e94cd50b-07fb-4e28-a46f-2fce25d1e9ff', '6b6d3e92-35f5-45f0-ba52-0f21ae2a59c0', '456ae1b3-c098-4666-b139-e84dd99ebffe'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:50.721079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:50.776702 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:50.827187 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:50.837035 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Deleted volume successfully. Jan 15 21:19:50.849334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:50.859710 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f4b43b27-18dd-47d9-985c-d97b0beca5bc tempest-VolumeTypesAccessTest-1434218405 None] Lock "b'cinder-6eb64d4d-cc92-485c-af99-78fc28a8b45b-delete_volume'" released by "delete_volume" :: held 0.745s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:50.886960 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:50.973138 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:19:50.981969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] deleting rbd volume volume-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:19:51.441073 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['e7a324b0-83d5-40ba-badc-9f332500fbdb', '7cc7747f-92c8-4c98-9557-4fae6d70aaa7', '1648ab27-9017-4b4e-8238-55ea27616277', 'a27ccebd-b958-47c1-bcee-496fc855c166'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:19:51.496202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:51.561073 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:19:51.623282 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:19:51.628638 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] Deleted volume successfully. Jan 15 21:19:51.656504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-f46b9061-f5bb-4d0c-a41f-1c7ca48f1069 req-cf04b5b6-32db-4c75-9031-a1c2d3a6adb2 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-5f0ec90c-8724-4e9f-a7cb-cf73a6e62eba-delete_volume'" released by "delete_volume" :: held 0.807s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:19:51.698311 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f183489-987c-4da0-9f00-26bb71953195 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-773cf368-b8b6-44db-9909-9b312ca3b6bc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:19:51.700693 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-9f183489-987c-4da0-9f00-26bb71953195 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:11.406970 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:11.415066 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:11.416463 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:11.449691 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (58cab294-8cc0-4476-8f90-7006a2e5db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:11.462862 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904617b8-dd91-4086-aee8-11425a650a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:11.470877 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:11.512085 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904617b8-dd91-4086-aee8-11425a650a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1388917104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=082d8c62-632a-4e00-ad03-e773f017e04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aca9c053ec54853934a057b46a98733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:11Z,use_quota=True,user_id='ed2d1c33594b4b508c6bf1cc7fd33784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:11.525402 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ba4933-3df0-43c9-afaf-2fa0415b8901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:11.530804 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ba4933-3df0-43c9-afaf-2fa0415b8901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:11.540012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c96fdb-1fdf-4f95-9e3f-904367eafee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:11.544325 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c96fdb-1fdf-4f95-9e3f-904367eafee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082d8c62-632a-4e00-ad03-e773f017e04e', 'volume_name': 'volume-082d8c62-632a-4e00-ad03-e773f017e04e', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:11.549320 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4b5050-5160-42f6-b17e-ca19a3d6cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:11.554630 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4b5050-5160-42f6-b17e-ca19a3d6cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:11.559725 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32f70a7-579e-452f-a6b9-9c155944a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:11.561055 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Volume 082d8c62-632a-4e00-ad03-e773f017e04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082d8c62-632a-4e00-ad03-e773f017e04e', 'volume_size': 1} Jan 15 21:20:11.561598 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] creating volume 'volume-082d8c62-632a-4e00-ad03-e773f017e04e' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:20:11.562765 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:11.688400 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:11.690073 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:11.698224 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32f70a7-579e-452f-a6b9-9c155944a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082d8c62-632a-4e00-ad03-e773f017e04e', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:11.706634 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5f324f-244b-4cb3-ac89-74eb8f444fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:11.724767 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Volume volume-082d8c62-632a-4e00-ad03-e773f017e04e (082d8c62-632a-4e00-ad03-e773f017e04e): created successfully Jan 15 21:20:11.731598 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5f324f-244b-4cb3-ac89-74eb8f444fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:11.743791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (58cab294-8cc0-4476-8f90-7006a2e5db21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:11.754183 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d8d6990c-fbc0-43af-81f3-f30c6e3d0a29 tempest-VolumesActionsTest-1908025685 None] Created volume successfully. Jan 15 21:20:12.471549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-183bc13c-8ff4-4ee0-bdb2-ccf1ced63741 tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e'" acquired by "attach_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:12.579734 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-183bc13c-8ff4-4ee0-bdb2-ccf1ced63741 tempest-VolumesActionsTest-1908025685 None] Attaching volume 082d8c62-632a-4e00-ad03-e773f017e04e to instance 3df06136-2b41-44b8-a0ab-79390c2d7d96 at mountpoint /dev/sdb on host None. Jan 15 21:20:12.639536 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-183bc13c-8ff4-4ee0-bdb2-ccf1ced63741 tempest-VolumesActionsTest-1908025685 None] Attach volume completed successfully. Jan 15 21:20:12.644788 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-183bc13c-8ff4-4ee0-bdb2-ccf1ced63741 tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e'" released by "attach_volume" :: held 0.173s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:13.339610 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e18f9a03-af79-4915-a9f1-d28dc0655415 tempest-VolumesActionsTest-957335855 None] Terminate volume connection completed successfully. Jan 15 21:20:13.402413 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e18f9a03-af79-4915-a9f1-d28dc0655415 tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:13.422166 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e18f9a03-af79-4915-a9f1-d28dc0655415 tempest-VolumesActionsTest-957335855 None] Detaching volume 082d8c62-632a-4e00-ad03-e773f017e04e from instance 3df06136-2b41-44b8-a0ab-79390c2d7d96. Jan 15 21:20:13.475397 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e18f9a03-af79-4915-a9f1-d28dc0655415 tempest-VolumesActionsTest-957335855 None] Detach volume completed successfully. Jan 15 21:20:13.481775 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e18f9a03-af79-4915-a9f1-d28dc0655415 tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e-detach_volume'" released by "detach_volume" :: held 0.080s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:13.727460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c19172d2-9b52-4dd6-8ad4-5a38d3e10fe9 tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:13.728252 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c19172d2-9b52-4dd6-8ad4-5a38d3e10fe9 tempest-VolumesActionsTest-1908025685 None] Volume detach called, but volume not attached. Jan 15 21:20:13.749189 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c19172d2-9b52-4dd6-8ad4-5a38d3e10fe9 tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e-detach_volume'" released by "detach_volume" :: held 0.020s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:18.203954 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:18.209774 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:18.210961 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:18.297447 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (d63952d8-1303-4578-aa92-5b5c48b074b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:18.318851 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ab92f2-42c2-4d43-82a6-c1dd3e391921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:18.329217 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:18.356298 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ab92f2-42c2-4d43-82a6-c1dd3e391921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-207537191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee335ee8-0569-4b01-8408-433141a45f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aca9c053ec54853934a057b46a98733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:18Z,use_quota=True,user_id='ed2d1c33594b4b508c6bf1cc7fd33784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:18.365424 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d31134-82fe-4087-ad10-d72f71323557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:18.371832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d31134-82fe-4087-ad10-d72f71323557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:18.380271 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e797bdc-79ea-42ab-a706-ef455f68bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:18.385306 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e797bdc-79ea-42ab-a706-ef455f68bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee335ee8-0569-4b01-8408-433141a45f21', 'volume_name': 'volume-ee335ee8-0569-4b01-8408-433141a45f21', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:18.391455 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f60692-62f5-4edf-9179-8be9d144c8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:18.397380 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f60692-62f5-4edf-9179-8be9d144c8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:18.403751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cc1657-591e-4a8b-bd5f-fef79c2d16e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:18.406281 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Volume ee335ee8-0569-4b01-8408-433141a45f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee335ee8-0569-4b01-8408-433141a45f21', 'volume_size': 1} Jan 15 21:20:18.407091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] creating volume 'volume-ee335ee8-0569-4b01-8408-433141a45f21' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:20:18.409716 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:18.561195 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:18.561597 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:18.566334 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cc1657-591e-4a8b-bd5f-fef79c2d16e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee335ee8-0569-4b01-8408-433141a45f21', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:18.571497 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a576ade-6154-43ac-8dc2-7792bc16412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:18.602790 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Volume volume-ee335ee8-0569-4b01-8408-433141a45f21 (ee335ee8-0569-4b01-8408-433141a45f21): created successfully Jan 15 21:20:18.619708 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a576ade-6154-43ac-8dc2-7792bc16412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:18.662248 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (d63952d8-1303-4578-aa92-5b5c48b074b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:18.684082 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a7a13cd1-de9b-4ec8-ab69-b69396970814 tempest-VolumesActionsTest-1908025685 None] Created volume successfully. Jan 15 21:20:19.572228 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-ee335ee8-0569-4b01-8408-433141a45f21-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:19.631640 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:19.734862 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:19.735358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] Volume volume-ee335ee8-0569-4b01-8408-433141a45f21 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:19.747668 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] deleting rbd volume volume-ee335ee8-0569-4b01-8408-433141a45f21 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:20.334461 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] Created reservations ['21e3ad2e-c4f3-466d-b94b-efff0699152b', '2c700aef-1b04-49fc-8fe7-725f2d3ec991', '03fd6947-ceec-43b7-8f20-b60dbd0c106f', '36490c90-c81f-453c-aeb0-d1c199dde815'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:20.392239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:20.435504 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:20.471964 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:20.479214 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] Deleted volume successfully. Jan 15 21:20:20.503391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-35b49792-9ef3-40cb-9d66-77b4c61f72b8 tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-ee335ee8-0569-4b01-8408-433141a45f21-delete_volume'" released by "delete_volume" :: held 0.931s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:21.175346 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:21.181858 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:21.182672 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:21.203367 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (766f82d4-eecf-48eb-91bf-ef3a23fd1f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:21.210910 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3b69cd-bf3f-4ede-bf67-a0d21466b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:21.218914 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:21.234447 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3b69cd-bf3f-4ede-bf67-a0d21466b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408145465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=729bc594-21ea-4eeb-943c-a45a9275de8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aca9c053ec54853934a057b46a98733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:21Z,use_quota=True,user_id='ed2d1c33594b4b508c6bf1cc7fd33784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:21.240131 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b96c1b-1634-485e-9ea6-04e472811aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:21.250527 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b96c1b-1634-485e-9ea6-04e472811aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:21.257042 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf36666-3fc2-43de-a34f-cdeda94d0ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:21.261596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf36666-3fc2-43de-a34f-cdeda94d0ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '729bc594-21ea-4eeb-943c-a45a9275de8d', 'volume_name': 'volume-729bc594-21ea-4eeb-943c-a45a9275de8d', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:21.267248 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890dddc5-996a-41ae-aea0-c9ddcb5c4c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:21.272031 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890dddc5-996a-41ae-aea0-c9ddcb5c4c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:21.276856 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa591ad-4fcb-4275-ab0a-035bc1222c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:21.277965 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Volume 729bc594-21ea-4eeb-943c-a45a9275de8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-729bc594-21ea-4eeb-943c-a45a9275de8d', 'volume_size': 1} Jan 15 21:20:21.278362 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] creating volume 'volume-729bc594-21ea-4eeb-943c-a45a9275de8d' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:20:21.279358 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:21.367071 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:21.367697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:21.372300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa591ad-4fcb-4275-ab0a-035bc1222c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729bc594-21ea-4eeb-943c-a45a9275de8d', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:21.379658 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd271e5e-c5c1-49dd-a962-540a6624780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:21.392571 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Volume volume-729bc594-21ea-4eeb-943c-a45a9275de8d (729bc594-21ea-4eeb-943c-a45a9275de8d): created successfully Jan 15 21:20:21.397796 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd271e5e-c5c1-49dd-a962-540a6624780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:21.403894 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (766f82d4-eecf-48eb-91bf-ef3a23fd1f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:21.421238 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d64d98c3-c670-4300-a7ce-dfede8ba5d5b tempest-VolumesActionsTest-1908025685 None] Created volume successfully. Jan 15 21:20:21.912832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-9f183489-987c-4da0-9f00-26bb71953195 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['8a823f8e-f883-472d-a891-dbabe0ae4460', '97183a7e-152d-4fc9-8924-b4b57a061184', '48a77a01-23a4-48df-a60b-fd4c44ba20bf', '3fbadd62-1959-4f43-a1d7-e9c3d38e72d5'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:21.970283 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-9f183489-987c-4da0-9f00-26bb71953195 tempest-TestVolumeBootPattern-1854138725 None] Delete snapshot completed successfully. Jan 15 21:20:21.979871 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-9f183489-987c-4da0-9f00-26bb71953195 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-773cf368-b8b6-44db-9909-9b312ca3b6bc-delete_snapshot'" released by "delete_snapshot" :: held 30.281s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:22.457068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-729bc594-21ea-4eeb-943c-a45a9275de8d-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:22.510468 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:22.588863 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:22.590055 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] Volume volume-729bc594-21ea-4eeb-943c-a45a9275de8d is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:22.603599 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] deleting rbd volume volume-729bc594-21ea-4eeb-943c-a45a9275de8d {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:23.018981 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] Created reservations ['eb18d871-5bfe-49e0-8514-6e62e7a16eb6', 'ad7ec4f5-a9f6-4807-b6f5-20dd500c12b6', '0d7c242f-9316-4dfa-bfff-8945b997bd45', 'f82c0c39-0744-489f-801a-cf230affaaad'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:23.071454 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:23.100535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:23.127521 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:23.133152 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] Deleted volume successfully. Jan 15 21:20:23.148298 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-d7e9fd0b-63e1-41d5-8e99-7aaaf69b827f tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-729bc594-21ea-4eeb-943c-a45a9275de8d-delete_volume'" released by "delete_volume" :: held 0.693s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:23.975176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:23.980778 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:23.981734 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:24.002129 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (7d7ced9e-a071-431b-8925-1a07c2c03374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:24.009201 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36250b56-4494-4974-bc5f-1fb91a50bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:24.016644 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:24.037812 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36250b56-4494-4974-bc5f-1fb91a50bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-601059217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59b05b7d-5a10-4b00-812f-3dba0950b28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aca9c053ec54853934a057b46a98733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:24Z,use_quota=True,user_id='ed2d1c33594b4b508c6bf1cc7fd33784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:24.044832 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2c5e54-1e52-4705-8d60-65f422230611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:24.050376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2c5e54-1e52-4705-8d60-65f422230611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:24.057039 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f868fbb8-381b-4101-9e34-68927d994a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:24.061258 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f868fbb8-381b-4101-9e34-68927d994a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b05b7d-5a10-4b00-812f-3dba0950b28a', 'volume_name': 'volume-59b05b7d-5a10-4b00-812f-3dba0950b28a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:24.067336 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b8c188-7a21-47b5-bf37-e127d346682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:24.071732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b8c188-7a21-47b5-bf37-e127d346682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:24.077425 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75441a9f-7e48-4f5a-9c33-d35530335edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:24.079472 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Volume 59b05b7d-5a10-4b00-812f-3dba0950b28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b05b7d-5a10-4b00-812f-3dba0950b28a', 'volume_size': 1} Jan 15 21:20:24.080080 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] creating volume 'volume-59b05b7d-5a10-4b00-812f-3dba0950b28a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:20:24.081187 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:24.178956 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:24.179399 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:24.183630 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75441a9f-7e48-4f5a-9c33-d35530335edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b05b7d-5a10-4b00-812f-3dba0950b28a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:24.193798 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387c6763-636d-4961-bd41-202ff27a8d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:24.209929 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Volume volume-59b05b7d-5a10-4b00-812f-3dba0950b28a (59b05b7d-5a10-4b00-812f-3dba0950b28a): created successfully Jan 15 21:20:24.224249 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (387c6763-636d-4961-bd41-202ff27a8d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:24.233490 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (7d7ced9e-a071-431b-8925-1a07c2c03374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:24.280745 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-82a39214-7e24-44f8-9c82-5f4503649f28 tempest-VolumesActionsTest-1908025685 None] Created volume successfully. Jan 15 21:20:25.007161 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-53f7c32a-b03a-439a-8ff7-027c4eb23e01 tempest-TestVolumeBootPattern-1854138725 None] Terminate volume connection completed successfully. Jan 15 21:20:25.008200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-53f7c32a-b03a-439a-8ff7-027c4eb23e01 tempest-TestVolumeBootPattern-1854138725 None] Deleting attachment 54611ed6-ec3a-4fca-a33f-a72aaa96e9ae. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:20:25.186427 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-5a60bb93-fa3d-4edd-92d3-808762b016b9-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:25.279991 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:25.421367 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:25.438067 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] deleting rbd volume volume-5a60bb93-fa3d-4edd-92d3-808762b016b9 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:25.440382 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-59b05b7d-5a10-4b00-812f-3dba0950b28a-delete_volume'" acquired by "delete_volume" :: waited 0.206s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:25.496124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:25.599875 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:25.600286 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] Volume volume-59b05b7d-5a10-4b00-812f-3dba0950b28a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:25.619676 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] deleting rbd volume volume-59b05b7d-5a10-4b00-812f-3dba0950b28a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:25.923878 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:20:25.968065 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] deleting parent snapshot volume-5a60bb93-fa3d-4edd-92d3-808762b016b9.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:20:26.608414 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['c79762b8-1c3c-413a-a7b5-0292c97ac0d4', '51097043-2bea-442b-8f38-cf27abb99ca3', '1d340983-9e6f-4622-a7d0-1eec3265e29e', 'df80e51a-cb7f-45b5-8a8a-7fadd6871428'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:26.617921 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] Created reservations ['b007c0b5-835c-49cc-8a3f-377185217adc', 'd7acef00-bd38-4b67-a6ea-f0beca991d63', '91adfa09-6f1d-4a2f-ad76-f5421d2903ec', '4cd6a39e-0b47-4186-a11e-23f11d7e94a1'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:26.669514 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:26.691596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:26.737098 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:26.742899 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] Deleted volume successfully. Jan 15 21:20:26.762109 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:26.789091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:26.816938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:26.819079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-d1ff8e51-b6f2-486c-a1a5-592ea347b4ca req-6cd56c21-d955-4a5f-9b9d-ff79e0991b09 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-5a60bb93-fa3d-4edd-92d3-808762b016b9-delete_volume'" released by "delete_volume" :: held 1.633s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:26.822028 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] Deleted volume successfully. Jan 15 21:20:26.833676 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-ecf8c4dc-c3fa-4edb-9f2c-ae60f3165047 tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-59b05b7d-5a10-4b00-812f-3dba0950b28a-delete_volume'" released by "delete_volume" :: held 1.393s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:27.763175 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:27.767215 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:27.767672 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:27.789761 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (9e8f3b08-a826-4fa3-ae39-01701daa56b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:27.796574 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e25ff3-4cbd-4b9e-b312-b96e2d3d0f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:27.805774 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:27.823026 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e25ff3-4cbd-4b9e-b312-b96e2d3d0f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1934021214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98f659e5-3286-4baf-8dba-7639d30368e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aca9c053ec54853934a057b46a98733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:28Z,use_quota=True,user_id='ed2d1c33594b4b508c6bf1cc7fd33784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:27.828872 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9964dbfb-3917-4de8-abe1-a818968d537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:27.834052 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9964dbfb-3917-4de8-abe1-a818968d537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:27.839346 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d8fd6a-29b0-44bf-8a10-7d135cf912da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:27.843719 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d8fd6a-29b0-44bf-8a10-7d135cf912da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f659e5-3286-4baf-8dba-7639d30368e0', 'volume_name': 'volume-98f659e5-3286-4baf-8dba-7639d30368e0', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:27.848903 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13c62a1-5596-4104-af88-7880dd5f0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:27.853002 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13c62a1-5596-4104-af88-7880dd5f0382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:27.857717 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c937fb-655c-4bb9-aabe-15fff002c517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:27.858790 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Volume 98f659e5-3286-4baf-8dba-7639d30368e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f659e5-3286-4baf-8dba-7639d30368e0', 'volume_size': 1} Jan 15 21:20:27.859174 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] creating volume 'volume-98f659e5-3286-4baf-8dba-7639d30368e0' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:20:27.860143 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:27.912561 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:27.912984 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:27.916713 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c937fb-655c-4bb9-aabe-15fff002c517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f659e5-3286-4baf-8dba-7639d30368e0', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:27.921485 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7440e20e-3e4f-486e-a8ab-14eb66787468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:27.931112 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Volume volume-98f659e5-3286-4baf-8dba-7639d30368e0 (98f659e5-3286-4baf-8dba-7639d30368e0): created successfully Jan 15 21:20:27.935028 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7440e20e-3e4f-486e-a8ab-14eb66787468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:27.940538 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (9e8f3b08-a826-4fa3-ae39-01701daa56b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:27.951949 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-54a323cd-f44d-43be-9b79-6e85e3c2e99d tempest-VolumesActionsTest-1908025685 None] Created volume successfully. Jan 15 21:20:28.966920 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-98f659e5-3286-4baf-8dba-7639d30368e0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:28.993739 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:29.039128 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:29.039481 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] Volume volume-98f659e5-3286-4baf-8dba-7639d30368e0 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:29.044675 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] deleting rbd volume volume-98f659e5-3286-4baf-8dba-7639d30368e0 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:29.266544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] Created reservations ['4208c7be-6b79-4947-ad70-dc28e20241ea', 'b23d7fae-0c7e-4d21-abbd-a3f8e1f6307b', 'd268e46b-dbcd-406d-8a84-e33273844d40', 'bd8d57d3-93c7-462e-b819-504ef708a41e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:29.310166 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:29.349022 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:29.388677 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:29.400780 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] Deleted volume successfully. Jan 15 21:20:29.419036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-84477567-6583-48ef-8ffc-b509a14692bb tempest-VolumesActionsTest-957335855 None] Lock "b'cinder-98f659e5-3286-4baf-8dba-7639d30368e0-delete_volume'" released by "delete_volume" :: held 0.452s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:29.632752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:29.636102 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:29.636696 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:29.656181 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (04d286e2-5a11-4bd2-907c-e20bc78817db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:29.664000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca57a7e-3085-4f1f-a682-a6dfe838c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:29.670583 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:29.684924 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca57a7e-3085-4f1f-a682-a6dfe838c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-214143506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbdfa075-f51a-46ac-b2a2-565a50bd7426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2ae6f05c2843469190cd96f39ac794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:30Z,use_quota=True,user_id='f0fc1955b0d446458f8f355550de971b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:29.690307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6884e952-1314-4359-b99c-6aada4c6702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:29.694589 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6884e952-1314-4359-b99c-6aada4c6702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:29.699746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38be9ef0-b319-44e5-a389-d6af22144fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:29.791053 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38be9ef0-b319-44e5-a389-d6af22144fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'volume_name': 'volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:29.797189 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454a6590-5955-443b-a710-9a4135d1a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:29.802003 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454a6590-5955-443b-a710-9a4135d1a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:29.807088 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7820622-872d-4688-bdeb-eaf65d38de59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:29.808674 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Volume dbdfa075-f51a-46ac-b2a2-565a50bd7426: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:20:29.809281 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Cloning dbdfa075-f51a-46ac-b2a2-565a50bd7426 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:20:29.819206 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:29.829357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 20, 29, 823448)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:20:29.829788 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:20:29.830194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:20:29.836492 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:29.837539 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:20:29.842876 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 20, 29, 840676)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:20:29.843296 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:20:29.843696 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:20:29.855697 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:29.905585 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] creating snapshot='volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:20:30.147178 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426.clone_snap' to 'volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:20:30.310880 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:30.313081 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:30.313820 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:30.341344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:20:30.342051 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Marking volume dbdfa075-f51a-46ac-b2a2-565a50bd7426 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:20:30.350157 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to dbdfa075-f51a-46ac-b2a2-565a50bd7426. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:20:30.350578 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Creating volume glance metadata for volume dbdfa075-f51a-46ac-b2a2-565a50bd7426 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:20:30.387092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:20:30.390248 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:20:30.390692 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:20:30.411009 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (695d16f0-dea7-4675-bcdf-3616f206c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:30.417405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db7226a-29a1-4f6f-9ff8-8ff76c535189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.426109 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:20:30.441758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db7226a-29a1-4f6f-9ff8-8ff76c535189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-229958886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f2ef9295-078e-4be3-9ad2-cfb049b7065d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aca9c053ec54853934a057b46a98733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:20:30Z,use_quota=True,user_id='ed2d1c33594b4b508c6bf1cc7fd33784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.447138 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d867a922-8f0b-4363-9fdb-f4c3014be472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.451243 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d867a922-8f0b-4363-9fdb-f4c3014be472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.456297 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4ee676-4605-4fb2-bdaf-85e58469c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.461133 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4ee676-4605-4fb2-bdaf-85e58469c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ef9295-078e-4be3-9ad2-cfb049b7065d', 'volume_name': 'volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.465991 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d7ce93-b9f2-421a-9d85-14029ee3b048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.469980 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d7ce93-b9f2-421a-9d85-14029ee3b048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.475273 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d03f8ac-30f3-4b49-96fc-e4162688491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.476340 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Volume f2ef9295-078e-4be3-9ad2-cfb049b7065d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d', 'volume_size': 1} Jan 15 21:20:30.476702 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] creating volume 'volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:20:30.477673 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:30.523146 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7820622-872d-4688-bdeb-eaf65d38de59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.527873 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179baf6d-c575-4b93-ba90-4bb44fdf069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.537906 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Volume volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426 (dbdfa075-f51a-46ac-b2a2-565a50bd7426): created successfully Jan 15 21:20:30.541828 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179baf6d-c575-4b93-ba90-4bb44fdf069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.547435 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (04d286e2-5a11-4bd2-907c-e20bc78817db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:30.556610 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:20:30.557015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:20:30.561166 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d03f8ac-30f3-4b49-96fc-e4162688491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.566145 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe350104-ab22-4526-97f1-5fe04ae64c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:20:30.575748 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7014f4ca-8726-4aa8-9a13-c85f4fae446a tempest-TestVolumeBootPattern-1854138725 None] Created volume successfully. Jan 15 21:20:30.579503 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Volume volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d (f2ef9295-078e-4be3-9ad2-cfb049b7065d): created successfully Jan 15 21:20:30.585270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe350104-ab22-4526-97f1-5fe04ae64c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:20:30.590939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Flow 'volume_create_manager' (695d16f0-dea7-4675-bcdf-3616f206c55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:20:30.601158 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e7140c6a-01ac-48c4-9f63-5aa79850bc89 tempest-VolumesActionsTest-1908025685 None] Created volume successfully. Jan 15 21:20:32.000580 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-f2ef9295-078e-4be3-9ad2-cfb049b7065d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:32.033509 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:32.075993 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:32.076422 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] Volume volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:32.083235 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] deleting rbd volume volume-f2ef9295-078e-4be3-9ad2-cfb049b7065d {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:32.287555 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] Created reservations ['e75dd5dc-3555-431d-ab44-422a3ca327c8', '56db5dd4-dab6-4ddd-af73-49d469e475dd', 'e1c5031f-eaed-46ba-b7d3-de1e65590073', '885b4d70-da93-4d00-acb1-3e617bcd9b64'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:32.330056 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:32.356436 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:32.382724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:32.386681 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] Deleted volume successfully. Jan 15 21:20:32.398649 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-0f0c81be-fdf3-4775-84a1-037b5be30ecf tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-f2ef9295-078e-4be3-9ad2-cfb049b7065d-delete_volume'" released by "delete_volume" :: held 0.398s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:32.787656 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-9264964c-055a-4dec-8df9-d6d72ec03388 req-00c48789-6d10-4826-9c9e-d7a00355be6b tempest-TestVolumeBootPattern-1854138725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:20:33.241750 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:20:33.323025 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:33.381751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:20:33.382292 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] Volume volume-082d8c62-632a-4e00-ad03-e773f017e04e is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:20:33.391163 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] deleting rbd volume volume-082d8c62-632a-4e00-ad03-e773f017e04e {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:20:33.552046 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-9264964c-055a-4dec-8df9-d6d72ec03388 req-00c48789-6d10-4826-9c9e-d7a00355be6b tempest-TestVolumeBootPattern-1854138725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.764s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:20:33.552831 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-9264964c-055a-4dec-8df9-d6d72ec03388 req-00c48789-6d10-4826-9c9e-d7a00355be6b tempest-TestVolumeBootPattern-1854138725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:20:33.578732 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-9264964c-055a-4dec-8df9-d6d72ec03388 req-00c48789-6d10-4826-9c9e-d7a00355be6b tempest-TestVolumeBootPattern-1854138725 None] Connection info returned from driver {'name': 'volumes/volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '90abbf2f-7ddd-4b40-a807-237e4719bdf7'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:20:33.661676 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-9264964c-055a-4dec-8df9-d6d72ec03388 req-00c48789-6d10-4826-9c9e-d7a00355be6b tempest-TestVolumeBootPattern-1854138725 None] attachment_update completed successfully. Jan 15 21:20:33.684698 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] Created reservations ['82703389-1fa6-4f0e-9e90-0ca5cc28eeba', '471c2fc8-d89d-47de-8568-5076f10fb858', '828314ad-d9ea-4681-9c6b-63d144735451', '0df51a8d-6603-4aeb-afdb-3885eb47039a'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:20:33.733838 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:33.778443 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:33.822390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:20:33.831294 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] Deleted volume successfully. Jan 15 21:20:33.862286 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-c3fef746-0c79-4d74-9275-a6b1bd226509 tempest-VolumesActionsTest-1908025685 None] Lock "b'cinder-082d8c62-632a-4e00-ad03-e773f017e04e-delete_volume'" released by "delete_volume" :: held 0.621s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:20:41.324879 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:20:41.325959 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:41.384032 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:20:41.415344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:21:11.542467 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:21:11.547671 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:21:11.548451 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:21:11.568773 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Flow 'volume_create_manager' (64138978-5296-4888-ab1c-4b34339a49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:21:11.575686 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e7e8de-7f86-4522-8756-db3a15fe4184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:11.583319 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:21:11.600710 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e7e8de-7f86-4522-8756-db3a15fe4184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1742775864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a4ab464-a9de-4070-bc0c-659687fd928e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295ec7c21a074bc4b8bdf0bcedf5e7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:21:12Z,use_quota=True,user_id='585670f672774f178f07e8cf2398b54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:11.606263 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4bc0cd-ea8e-491b-81a7-21c6549d00d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:11.610438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4bc0cd-ea8e-491b-81a7-21c6549d00d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:11.616670 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb07477-63f2-4283-b56c-730a554882d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:11.745349 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb07477-63f2-4283-b56c-730a554882d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a4ab464-a9de-4070-bc0c-659687fd928e', 'volume_name': 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:11.751091 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9fa848-be90-455b-8260-16d9a567118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:11.756469 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9fa848-be90-455b-8260-16d9a567118a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:11.766097 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07310195-7db9-417d-bd10-61a72cd69436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:11.768918 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Volume 3a4ab464-a9de-4070-bc0c-659687fd928e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:21:11.769831 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Cloning 3a4ab464-a9de-4070-bc0c-659687fd928e from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:21:11.783915 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:21:11.795460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 21, 11, 789434)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:21:11.795934 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:21:11.796477 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:21:11.801442 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:21:11.802401 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:21:11.808202 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 21, 11, 805976)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:21:11.808615 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:21:11.809035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:21:11.823688 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:21:11.894825 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] creating snapshot='volume-3a4ab464-a9de-4070-bc0c-659687fd928e.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:21:12.496344 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-3a4ab464-a9de-4070-bc0c-659687fd928e.clone_snap' to 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:21:12.637982 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:21:12.638991 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:21:12.639357 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:21:12.655278 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:21:12.655884 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Marking volume 3a4ab464-a9de-4070-bc0c-659687fd928e as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:21:12.664631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to 3a4ab464-a9de-4070-bc0c-659687fd928e. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:21:12.665209 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Creating volume glance metadata for volume 3a4ab464-a9de-4070-bc0c-659687fd928e backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:21:12.718668 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07310195-7db9-417d-bd10-61a72cd69436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4ab464-a9de-4070-bc0c-659687fd928e', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:12.723639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ed0ac-cb22-4893-8173-acda3c94d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:12.733086 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Volume volume-3a4ab464-a9de-4070-bc0c-659687fd928e (3a4ab464-a9de-4070-bc0c-659687fd928e): created successfully Jan 15 21:21:12.736777 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ed0ac-cb22-4893-8173-acda3c94d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:12.743205 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Flow 'volume_create_manager' (64138978-5296-4888-ab1c-4b34339a49d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:21:12.755523 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-f1571a4b-dd73-45e8-94cd-4a442b2cc7a0 tempest-TestVolumeBackupRestore-1457821269 None] Created volume successfully. Jan 15 21:21:14.053211 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:21:14.883189 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.830s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:21:14.884300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3a4ab464-a9de-4070-bc0c-659687fd928e', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '3a4ab464-a9de-4070-bc0c-659687fd928e', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:21:14.914969 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Initialize volume connection completed successfully. Jan 15 21:21:19.717680 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Terminate volume connection completed successfully. Jan 15 21:21:19.734692 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-42b0b976-b806-483c-99d3-45247029c1a5 tempest-TestVolumeBackupRestore-1457821269 None] Remove volume export completed successfully. Jan 15 21:21:20.515068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:21:20.519371 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:21:20.520006 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:21:20.543285 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Flow 'volume_create_manager' (a32b9a86-8dc8-443e-9ef0-bb749a3b9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:21:20.550349 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0206c992-ac89-4f0d-b2d0-afb0ee48e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:20.559608 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:21:20.578387 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0206c992-ac89-4f0d-b2d0-afb0ee48e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:21:20Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_c32e5733-73a3-4752-8300-0a48c780cef7',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd619176-6e0b-4a31-92d4-89d5b07e409a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295ec7c21a074bc4b8bdf0bcedf5e7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:21:20Z,use_quota=True,user_id='585670f672774f178f07e8cf2398b54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:20.584850 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6790a67e-455f-4b3a-acda-6dc5e3bddd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:20.589729 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6790a67e-455f-4b3a-acda-6dc5e3bddd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:20.594881 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a92dc6-a267-4875-9a48-cb62fc95a2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:20.600194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a92dc6-a267-4875-9a48-cb62fc95a2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd619176-6e0b-4a31-92d4-89d5b07e409a', 'volume_name': 'volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:20.605094 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecf0b1d-5183-49ac-95c9-461e1515d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:20.609938 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecf0b1d-5183-49ac-95c9-461e1515d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:20.615307 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f74ebdf-ecea-469b-89b7-03280bf4f853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:20.616379 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Volume bd619176-6e0b-4a31-92d4-89d5b07e409a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'volume_size': 1} Jan 15 21:21:20.616773 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] creating volume 'volume-bd619176-6e0b-4a31-92d4-89d5b07e409a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:21:20.617883 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:21:20.687790 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:21:20.688169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:21:20.693240 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f74ebdf-ecea-469b-89b7-03280bf4f853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:20.698560 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013f3872-63c0-4ff7-bdd2-dc4e98d43aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:21:20.709490 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Volume volume-bd619176-6e0b-4a31-92d4-89d5b07e409a (bd619176-6e0b-4a31-92d4-89d5b07e409a): created successfully Jan 15 21:21:20.713267 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013f3872-63c0-4ff7-bdd2-dc4e98d43aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:21:20.719044 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Flow 'volume_create_manager' (a32b9a86-8dc8-443e-9ef0-bb749a3b9124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:21:20.727339 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Created volume successfully. Jan 15 21:21:21.620070 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:21:22.351031 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.730s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:21:22.353068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'bd619176-6e0b-4a31-92d4-89d5b07e409a', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:21:22.381350 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Initialize volume connection completed successfully. Jan 15 21:21:26.468467 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Terminate volume connection completed successfully. Jan 15 21:21:26.485164 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-7d8f44fe-29a8-41cf-a52e-4a078e028aff tempest-TestVolumeBackupRestore-1457821269 None] Remove volume export completed successfully. Jan 15 21:21:30.005782 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-663d0c54-a005-4aab-b3d2-568557be2aec req-5a0f28e4-f1a8-45cc-8dd9-8d6ed134e004 tempest-TestVolumeBackupRestore-1457821269 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:21:30.696272 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-663d0c54-a005-4aab-b3d2-568557be2aec req-5a0f28e4-f1a8-45cc-8dd9-8d6ed134e004 tempest-TestVolumeBackupRestore-1457821269 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.690s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:21:30.697270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-663d0c54-a005-4aab-b3d2-568557be2aec req-5a0f28e4-f1a8-45cc-8dd9-8d6ed134e004 tempest-TestVolumeBackupRestore-1457821269 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'bd619176-6e0b-4a31-92d4-89d5b07e409a', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:21:30.718750 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-663d0c54-a005-4aab-b3d2-568557be2aec req-5a0f28e4-f1a8-45cc-8dd9-8d6ed134e004 tempest-TestVolumeBackupRestore-1457821269 None] Connection info returned from driver {'name': 'volumes/volume-bd619176-6e0b-4a31-92d4-89d5b07e409a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bd619176-6e0b-4a31-92d4-89d5b07e409a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '80c282aa-6ec4-4d71-9208-f9b1a778888e'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:21:30.773556 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-663d0c54-a005-4aab-b3d2-568557be2aec req-5a0f28e4-f1a8-45cc-8dd9-8d6ed134e004 tempest-TestVolumeBackupRestore-1457821269 None] attachment_update completed successfully. Jan 15 21:21:41.330501 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:21:41.332191 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:21:41.370923 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:21:41.403168 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:22:29.741536 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-40ae6df0-fa83-4420-971c-0ae3f19939a3 req-898f8471-8346-4a09-b3ac-ee227ac65b88 tempest-TestVolumeBackupRestore-1457821269 None] Terminate volume connection completed successfully. Jan 15 21:22:29.742251 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-40ae6df0-fa83-4420-971c-0ae3f19939a3 req-898f8471-8346-4a09-b3ac-ee227ac65b88 tempest-TestVolumeBackupRestore-1457821269 None] Deleting attachment 80c282aa-6ec4-4d71-9208-f9b1a778888e. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:22:31.195098 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] Lock "b'cinder-bd619176-6e0b-4a31-92d4-89d5b07e409a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:22:31.228060 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:31.467167 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] Volume volume-bd619176-6e0b-4a31-92d4-89d5b07e409a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:22:31.485447 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] deleting rbd volume volume-bd619176-6e0b-4a31-92d4-89d5b07e409a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:22:31.498728 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] Lock "b'cinder-3a4ab464-a9de-4070-bc0c-659687fd928e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:22:31.535593 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:32.482376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] deleting rbd volume volume-3a4ab464-a9de-4070-bc0c-659687fd928e {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:22:32.523176 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] Created reservations ['5ab3feb7-8c1a-46d3-ae05-8702c5cbde47', '1a4df246-cf0c-44f2-b881-05c86f808726', '7349e5d7-ca2d-468f-8b1f-269506839edd', 'd3aaecf6-b5d4-4267-9182-be35cad60013'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:22:32.571836 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:32.601484 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:32.631364 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:22:32.635864 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] Deleted volume successfully. Jan 15 21:22:32.649740 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-177ec8bc-6414-4e8d-9565-b3598c1fb140 tempest-TestVolumeBackupRestore-1457821269 None] Lock "b'cinder-bd619176-6e0b-4a31-92d4-89d5b07e409a-delete_volume'" released by "delete_volume" :: held 1.455s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:22:32.670781 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:22:32.702888 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] deleting parent snapshot volume-3a4ab464-a9de-4070-bc0c-659687fd928e.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:22:33.528029 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] Created reservations ['c06e3b9e-bb90-4f77-b43b-7d6b1d027045', 'c3bc6210-543a-4452-8838-ccdbdbd6f798', 'ab0dbaca-3ff5-4ef7-9635-3ff96b1e709c', '3d081dfe-dafe-452e-99de-ba68ba0b9448'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:22:33.570295 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:33.592145 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:33.615171 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:22:33.619909 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] Deleted volume successfully. Jan 15 21:22:33.631304 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-519008ca-6859-4fc3-9671-80a6762848e9 tempest-TestVolumeBackupRestore-1457821269 None] Lock "b'cinder-3a4ab464-a9de-4070-bc0c-659687fd928e-delete_volume'" released by "delete_volume" :: held 2.133s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:22:41.329684 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:22:41.330368 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:41.369660 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:22:41.408276 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:23:01.325380 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-f9d05660-0615-4def-a1b8-38c10436ef4a req-84a3178f-2ad5-4c67-b9c6-c0246c0bec7b tempest-TestVolumeBootPattern-1854138725 None] Terminate volume connection completed successfully. Jan 15 21:23:01.326080 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-f9d05660-0615-4def-a1b8-38c10436ef4a req-84a3178f-2ad5-4c67-b9c6-c0246c0bec7b tempest-TestVolumeBootPattern-1854138725 None] Deleting attachment 90abbf2f-7ddd-4b40-a807-237e4719bdf7. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:23:08.857772 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-1994ab5e-709b-4b59-b8c2-5ee28c276383 req-8d365e09-6195-45b5-b50a-45267e8b7756 tempest-TestVolumeBootPattern-1854138725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:23:09.566246 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-1994ab5e-709b-4b59-b8c2-5ee28c276383 req-8d365e09-6195-45b5-b50a-45267e8b7756 tempest-TestVolumeBootPattern-1854138725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.708s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:23:09.566981 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-1994ab5e-709b-4b59-b8c2-5ee28c276383 req-8d365e09-6195-45b5-b50a-45267e8b7756 tempest-TestVolumeBootPattern-1854138725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:23:09.590843 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-1994ab5e-709b-4b59-b8c2-5ee28c276383 req-8d365e09-6195-45b5-b50a-45267e8b7756 tempest-TestVolumeBootPattern-1854138725 None] Connection info returned from driver {'name': 'volumes/volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dbdfa075-f51a-46ac-b2a2-565a50bd7426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0425aeec-3b11-4827-a826-02bf45941c55'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:23:09.642710 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-1994ab5e-709b-4b59-b8c2-5ee28c276383 req-8d365e09-6195-45b5-b50a-45267e8b7756 tempest-TestVolumeBootPattern-1854138725 None] attachment_update completed successfully. Jan 15 21:23:41.335109 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:23:41.335968 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:23:41.364478 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:23:41.392061 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:24:41.337739 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:24:41.338500 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:24:41.360441 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:24:41.385544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:25:09.374015 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-b0dc6cbb-e663-43d2-b9ce-db64b05f4160 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:25:09.573875 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-b0dc6cbb-e663-43d2-b9ce-db64b05f4160 tempest-TestVolumeBootPattern-1854138725 None] Create snapshot completed successfully Jan 15 21:25:10.776182 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:25:10.780548 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:25:10.781066 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:25:10.809752 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (1288b4d7-a7fc-4868-9a2e-10e1d29b45e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:25:10.816295 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bee68c2-5e64-430f-943c-33113cdbbada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:25:10.823596 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:25:10.837598 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bee68c2-5e64-430f-943c-33113cdbbada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-837861759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efc59638-e0bd-48fc-bfbe-832ab08a7c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2ae6f05c2843469190cd96f39ac794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2fbe161c-f4e2-499e-8bc9-262a16b98ffb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:25:11Z,use_quota=True,user_id='f0fc1955b0d446458f8f355550de971b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:25:10.842942 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f96064-0134-4846-b00c-c948574cd3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:25:10.847036 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f96064-0134-4846-b00c-c948574cd3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:25:10.852222 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b7f02-82bd-49fe-bbf9-5aa8f50dea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:25:10.856351 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b7f02-82bd-49fe-bbf9-5aa8f50dea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'volume_name': 'volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'volume_size': 1, 'snapshot_id': '2fbe161c-f4e2-499e-8bc9-262a16b98ffb'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:25:10.861257 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99659dbd-0086-4161-8242-def4b82c3b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:25:10.866148 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99659dbd-0086-4161-8242-def4b82c3b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:25:10.871076 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f4314-7e4b-4342-88af-d233dea688c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:25:10.872287 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Volume efc59638-e0bd-48fc-bfbe-832ab08a7c77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'volume_size': 1, 'snapshot_id': '2fbe161c-f4e2-499e-8bc9-262a16b98ffb'} Jan 15 21:25:10.895166 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] cloning volumes/volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426@snapshot-2fbe161c-f4e2-499e-8bc9-262a16b98ffb to volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77 {{(pid=122725) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1028}} Jan 15 21:25:10.896000 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:25:10.955952 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:25:11.077818 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:25:11.078133 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:25:11.096311 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Marking volume efc59638-e0bd-48fc-bfbe-832ab08a7c77 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:25:11.101116 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Copying metadata from snapshot 2fbe161c-f4e2-499e-8bc9-262a16b98ffb to efc59638-e0bd-48fc-bfbe-832ab08a7c77. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:422}} Jan 15 21:25:11.131410 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f4314-7e4b-4342-88af-d233dea688c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'volume_size': 1, 'snapshot_id': '2fbe161c-f4e2-499e-8bc9-262a16b98ffb'}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:25:11.136035 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d4fcfb-0704-45cd-97a8-7c7e26a3e2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:25:11.143991 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Volume volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77 (efc59638-e0bd-48fc-bfbe-832ab08a7c77): created successfully Jan 15 21:25:11.147840 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d4fcfb-0704-45cd-97a8-7c7e26a3e2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:25:11.153315 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Flow 'volume_create_manager' (1288b4d7-a7fc-4868-9a2e-10e1d29b45e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:25:11.166092 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e1c35c2b-84e7-4600-9837-835319f42f44 tempest-TestVolumeBootPattern-1854138725 None] Created volume successfully. Jan 15 21:25:13.898831 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa req-c0cb9507-1f10-4213-be8c-82752e644187 tempest-TestVolumeBootPattern-1854138725 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:25:14.605587 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa req-c0cb9507-1f10-4213-be8c-82752e644187 tempest-TestVolumeBootPattern-1854138725 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.706s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:25:14.606681 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa req-c0cb9507-1f10-4213-be8c-82752e644187 tempest-TestVolumeBootPattern-1854138725 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:25:14.629708 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa req-c0cb9507-1f10-4213-be8c-82752e644187 tempest-TestVolumeBootPattern-1854138725 None] Connection info returned from driver {'name': 'volumes/volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'efc59638-e0bd-48fc-bfbe-832ab08a7c77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '237a4350-83f8-4e5b-8637-7e5cbd8cf5f5'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:25:14.683618 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-b926bf32-0cb3-4b72-a74f-bcd6b3a471aa req-c0cb9507-1f10-4213-be8c-82752e644187 tempest-TestVolumeBootPattern-1854138725 None] attachment_update completed successfully. Jan 15 21:25:41.340434 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:25:41.342457 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:25:41.366592 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:25:41.389544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:26:41.346781 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:26:41.347542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:26:41.370468 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:26:41.395319 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:27:06.532115 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a req-1dcb552c-1c91-41b5-ac60-385cb9861197 tempest-TestVolumeBootPattern-1854138725 None] Terminate volume connection completed successfully. Jan 15 21:27:06.532774 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-f9d7fed4-8c83-4fcd-adbc-761dacbc7f7a req-1dcb552c-1c91-41b5-ac60-385cb9861197 tempest-TestVolumeBootPattern-1854138725 None] Deleting attachment 237a4350-83f8-4e5b-8637-7e5cbd8cf5f5. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:27:07.985578 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-efc59638-e0bd-48fc-bfbe-832ab08a7c77-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:27:08.015599 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:08.093391 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:27:08.100092 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] deleting rbd volume volume-efc59638-e0bd-48fc-bfbe-832ab08a7c77 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:27:08.347032 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['789a4129-d25b-4b03-bd94-3b023ece4029', 'a00e72e0-fa5b-4b03-833f-de5ed33aaa21', 'b6b93c28-5555-48ae-92f2-c909f361b464', '74370e6d-7fec-4d95-9645-381dddb7caf5'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:27:08.389240 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:08.412546 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:08.436457 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:27:08.440569 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] Deleted volume successfully. Jan 15 21:27:08.452138 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-cb7dd019-048b-4a5f-abb5-5488ad984633 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-efc59638-e0bd-48fc-bfbe-832ab08a7c77-delete_volume'" released by "delete_volume" :: held 0.467s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:27:09.115894 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-68acd2bc-96ec-43d8-9478-6ee103aa2a33 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-2fbe161c-f4e2-499e-8bc9-262a16b98ffb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:27:09.117793 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-68acd2bc-96ec-43d8-9478-6ee103aa2a33 tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:39.281068 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-68acd2bc-96ec-43d8-9478-6ee103aa2a33 tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['c6c910af-7b10-4dfb-9059-518d9f3d2d23', '7630d139-d071-41c4-a731-326cb126ff2b', '5d0d22a8-728b-4488-8d8a-52efa34ecaef', '176df3dd-0e14-4adc-a510-c2e273d43600'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:27:39.318755 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-68acd2bc-96ec-43d8-9478-6ee103aa2a33 tempest-TestVolumeBootPattern-1854138725 None] Delete snapshot completed successfully. Jan 15 21:27:39.323261 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-68acd2bc-96ec-43d8-9478-6ee103aa2a33 tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-2fbe161c-f4e2-499e-8bc9-262a16b98ffb-delete_snapshot'" released by "delete_snapshot" :: held 30.207s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:27:41.349851 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:27:41.351565 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:41.380666 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:41.406675 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:27:43.190972 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 req-5dd4197a-af26-4348-a018-29233ee69c9f tempest-TestVolumeBootPattern-1854138725 None] Terminate volume connection completed successfully. Jan 15 21:27:43.191599 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e02a4e82-e14b-4461-9ea8-4fc6bd389a29 req-5dd4197a-af26-4348-a018-29233ee69c9f tempest-TestVolumeBootPattern-1854138725 None] Deleting attachment 0425aeec-3b11-4827-a826-02bf45941c55. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:27:44.945468 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-dbdfa075-f51a-46ac-b2a2-565a50bd7426-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:27:44.975169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:45.037360 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:27:45.044701 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] deleting rbd volume volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:27:45.269646 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:27:45.301820 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] deleting parent snapshot volume-dbdfa075-f51a-46ac-b2a2-565a50bd7426.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:27:45.577247 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] Created reservations ['bcfc9c63-0010-4aa6-8ec6-6cef33e9f633', '67d66372-1607-40d5-83dc-3f0465973bf6', '084baede-53f1-4e71-8de9-576b12e5f2c1', '239d9198-ef8c-4859-9d58-16e9cfa86a3e'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:27:45.618758 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:45.652169 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:27:45.675206 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:27:45.679327 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] Deleted volume successfully. Jan 15 21:27:45.690991 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-e12f1762-d163-4084-8b21-0e1775571add tempest-TestVolumeBootPattern-1854138725 None] Lock "b'cinder-dbdfa075-f51a-46ac-b2a2-565a50bd7426-delete_volume'" released by "delete_volume" :: held 0.746s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:28:41.351917 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:28:41.352571 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:28:41.375093 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:28:41.398142 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:29:41.354622 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:29:41.356073 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:29:41.381412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:29:41.403362 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:30:41.358760 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:30:41.359473 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:30:41.385183 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:30:41.409803 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:31:41.356406 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:31:41.357158 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:31:41.382631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:31:41.406622 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:33:41.354755 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:33:41.355438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:33:41.379405 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:33:41.401800 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:34:41.357564 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:34:41.358278 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:34:41.386312 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:34:41.419366 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:35:41.354805 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:35:41.355588 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:35:41.381418 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:35:41.404509 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:36:41.360781 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:36:41.361469 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:36:41.383410 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:36:41.408099 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:37:41.363783 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:37:41.364475 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:37:41.390534 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:37:41.419889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:38:41.366859 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:38:41.367535 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:38:41.391121 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:38:41.414116 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:39:41.369542 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:39:41.370194 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:39:41.392238 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:39:41.416487 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:39:44.762360 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:39:44.766222 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:39:44.766702 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:39:44.787212 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Flow 'volume_create_manager' (b8bf5fd8-dcd7-4072-a247-194bd14bbe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:39:44.793704 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76bedc7-693f-4758-8394-10f2a1fc4fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:39:44.801077 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:39:44.815584 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76bedc7-693f-4758-8394-10f2a1fc4fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1502979532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8b1aa16-195c-48c5-8c3a-219ddecd770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d89bb23cded412ea3ca57cc844bfabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:39:45Z,use_quota=True,user_id='b3fbd604b5a640b480e5d115e469375e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:39:44.821006 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1dffb6-5c94-4e0e-b787-29fea03e0310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:39:44.825107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1dffb6-5c94-4e0e-b787-29fea03e0310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:39:44.830196 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b101bcc-6741-4e09-ab30-abeae1e23fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:39:44.834892 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b101bcc-6741-4e09-ab30-abeae1e23fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'volume_name': 'volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:39:44.839778 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae53f754-4e77-49fe-ada9-3a4986527196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:39:44.843855 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae53f754-4e77-49fe-ada9-3a4986527196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:39:44.849079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dad145-6f5c-484b-b9a1-987067fc3fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:39:44.850235 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Volume a8b1aa16-195c-48c5-8c3a-219ddecd770a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'volume_size': 1} Jan 15 21:39:44.850567 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] creating volume 'volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:39:44.851541 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:39:44.900249 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:39:44.900624 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:39:44.904460 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dad145-6f5c-484b-b9a1-987067fc3fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:39:44.909165 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36184ca3-d497-4957-84e5-be0ba4defd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:39:44.918823 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Volume volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a (a8b1aa16-195c-48c5-8c3a-219ddecd770a): created successfully Jan 15 21:39:44.922606 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36184ca3-d497-4957-84e5-be0ba4defd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:39:44.928616 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Flow 'volume_create_manager' (b8bf5fd8-dcd7-4072-a247-194bd14bbe16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:39:44.936101 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-d029b493-e46b-4f62-9910-70b3111ce0b3 tempest-ServerActionsTestJSON-1795151563 None] Created volume successfully. Jan 15 21:39:46.351055 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 req-db99de98-d45b-47a2-acaa-e3e7789b3678 tempest-ServerActionsTestJSON-1795151563 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:39:47.003906 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 req-db99de98-d45b-47a2-acaa-e3e7789b3678 tempest-ServerActionsTestJSON-1795151563 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:39:47.004893 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 req-db99de98-d45b-47a2-acaa-e3e7789b3678 tempest-ServerActionsTestJSON-1795151563 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:39:47.026894 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 req-db99de98-d45b-47a2-acaa-e3e7789b3678 tempest-ServerActionsTestJSON-1795151563 None] Connection info returned from driver {'name': 'volumes/volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '55b5a9fc-759f-4b5b-b405-b33e9d493208'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:39:47.072228 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-c8e8e409-001a-40ca-8341-fbbb1fcc2fd1 req-db99de98-d45b-47a2-acaa-e3e7789b3678 tempest-ServerActionsTestJSON-1795151563 None] attachment_update completed successfully. Jan 15 21:40:03.017163 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-fad51a45-d5ea-470e-91cc-6d643853e85b tempest-ServerActionsTestJSON-1795151563 None] Terminate volume connection completed successfully. Jan 15 21:40:03.017746 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-fad51a45-d5ea-470e-91cc-6d643853e85b tempest-ServerActionsTestJSON-1795151563 None] Deleting attachment 55b5a9fc-759f-4b5b-b405-b33e9d493208. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:40:04.972195 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-343abbf7-e40f-47da-bf24-3a58b0eac01f tempest-ServerActionsTestJSON-1795151563 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:40:05.615313 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-343abbf7-e40f-47da-bf24-3a58b0eac01f tempest-ServerActionsTestJSON-1795151563 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:40:05.616056 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-343abbf7-e40f-47da-bf24-3a58b0eac01f tempest-ServerActionsTestJSON-1795151563 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:40:05.637639 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-343abbf7-e40f-47da-bf24-3a58b0eac01f tempest-ServerActionsTestJSON-1795151563 None] Connection info returned from driver {'name': 'volumes/volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4f66ece9-baff-4f98-91cc-8655de89b59d'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:40:05.685803 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-879ff01e-00b0-4372-9fa3-db26a5b6cae9 req-343abbf7-e40f-47da-bf24-3a58b0eac01f tempest-ServerActionsTestJSON-1795151563 None] attachment_update completed successfully. Jan 15 21:40:12.762393 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-d0828a29-f035-4e22-bed6-fc1f4e5015b0 tempest-ServerActionsTestJSON-1795151563 None] Terminate volume connection completed successfully. Jan 15 21:40:12.763004 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-d0828a29-f035-4e22-bed6-fc1f4e5015b0 tempest-ServerActionsTestJSON-1795151563 None] Deleting attachment 4f66ece9-baff-4f98-91cc-8655de89b59d. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:40:15.171737 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-9ad0fbfb-8ae8-4345-bebf-bda5ed9b76bf tempest-ServerActionsTestJSON-1795151563 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:40:15.825263 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-9ad0fbfb-8ae8-4345-bebf-bda5ed9b76bf tempest-ServerActionsTestJSON-1795151563 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.653s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:40:15.826012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-9ad0fbfb-8ae8-4345-bebf-bda5ed9b76bf tempest-ServerActionsTestJSON-1795151563 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:40:15.848007 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-9ad0fbfb-8ae8-4345-bebf-bda5ed9b76bf tempest-ServerActionsTestJSON-1795151563 None] Connection info returned from driver {'name': 'volumes/volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8b1aa16-195c-48c5-8c3a-219ddecd770a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '86613a66-9971-4184-822a-90381ae11f70'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:40:15.893900 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e58c90d5-36c1-4a25-9a99-7c0316d095db req-9ad0fbfb-8ae8-4345-bebf-bda5ed9b76bf tempest-ServerActionsTestJSON-1795151563 None] attachment_update completed successfully. Jan 15 21:40:21.768824 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e req-f710e0f0-d8c4-42c8-99be-673e3173a6f2 tempest-ServerActionsTestJSON-1795151563 None] Terminate volume connection completed successfully. Jan 15 21:40:21.769434 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-ec1a6bfc-bd49-4e1a-b6d8-fbbe019cc44e req-f710e0f0-d8c4-42c8-99be-673e3173a6f2 tempest-ServerActionsTestJSON-1795151563 None] Deleting attachment 86613a66-9971-4184-822a-90381ae11f70. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:40:22.979329 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] Lock "b'cinder-a8b1aa16-195c-48c5-8c3a-219ddecd770a-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:40:23.012239 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:40:23.053350 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:40:23.053865 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] Volume volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:40:23.058672 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] deleting rbd volume volume-a8b1aa16-195c-48c5-8c3a-219ddecd770a {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:40:23.251848 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] Created reservations ['9e172d19-d36f-478f-b722-6692ae64b457', '02a88f14-c134-4c14-8426-3dd0e5d4453d', '8973fcc4-b860-4553-bcc7-3e3858d9ed4b', '255cb7f2-25e2-4032-924c-665048805ec3'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:40:23.291376 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:40:23.313568 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:40:23.337550 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:40:23.341836 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] Deleted volume successfully. Jan 15 21:40:23.354269 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-a8679c3a-68fd-4f13-b880-d4e005c23ee9 tempest-ServerActionsTestJSON-1795151563 None] Lock "b'cinder-a8b1aa16-195c-48c5-8c3a-219ddecd770a-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:40:41.372443 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:40:41.373125 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:40:41.395349 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:40:41.419624 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:41:41.374388 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:41:41.375110 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:41:41.407615 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:41:41.467935 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:41:56.464052 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:41:56.467758 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:41:56.468243 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:41:56.488631 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Flow 'volume_create_manager' (6be0ead3-d6e7-4546-982a-0f9ecd3ef730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:41:56.495542 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb16df21-b63b-4151-9aef-99a105e5ad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:41:56.501895 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:41:56.515917 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb16df21-b63b-4151-9aef-99a105e5ad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-812329625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=468f2646-1daf-493d-a48e-0a5e36e57a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3e3591eb6a485591b4e5b9dbf636ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:41:56Z,use_quota=True,user_id='82df3698420f49d495b7563b477680b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:41:56.521399 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05676b55-de08-4b0f-a8cf-6bd445fb4f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:41:56.526393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05676b55-de08-4b0f-a8cf-6bd445fb4f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:41:56.531588 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f0b8e2-c71d-43db-9316-ffce065a4fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:41:56.535780 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f0b8e2-c71d-43db-9316-ffce065a4fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468f2646-1daf-493d-a48e-0a5e36e57a61', 'volume_name': 'volume-468f2646-1daf-493d-a48e-0a5e36e57a61', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:41:56.541730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ab9699-6adf-442a-9df0-62a8d89fded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:41:56.545792 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ab9699-6adf-442a-9df0-62a8d89fded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:41:56.550745 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdd3523-ed4e-4d47-aeda-4b3b502ad7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:41:56.551823 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Volume 468f2646-1daf-493d-a48e-0a5e36e57a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468f2646-1daf-493d-a48e-0a5e36e57a61', 'volume_size': 1} Jan 15 21:41:56.552221 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] creating volume 'volume-468f2646-1daf-493d-a48e-0a5e36e57a61' {{(pid=122725) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:978}} Jan 15 21:41:56.553219 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:41:56.602889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:41:56.603270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:41:56.607041 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdd3523-ed4e-4d47-aeda-4b3b502ad7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468f2646-1daf-493d-a48e-0a5e36e57a61', 'volume_size': 1}' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:41:56.611645 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c65870-10d7-41f9-9bce-890b192fef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:41:56.620989 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Volume volume-468f2646-1daf-493d-a48e-0a5e36e57a61 (468f2646-1daf-493d-a48e-0a5e36e57a61): created successfully Jan 15 21:41:56.625447 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c65870-10d7-41f9-9bce-890b192fef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:41:56.632691 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Flow 'volume_create_manager' (6be0ead3-d6e7-4546-982a-0f9ecd3ef730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:41:56.640111 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-486c39bf-c1d2-435f-bb84-996c09cc0cda tempest-TestMinimumBasicScenario-659011030 None] Created volume successfully. Jan 15 21:41:58.016237 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-b9f7979a-e308-4952-bd0c-b160a6950601 req-08632411-2dd2-4378-ac3b-b97303b825aa tempest-TestMinimumBasicScenario-659011030 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:41:58.692777 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-b9f7979a-e308-4952-bd0c-b160a6950601 req-08632411-2dd2-4378-ac3b-b97303b825aa tempest-TestMinimumBasicScenario-659011030 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.676s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:41:58.693672 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-b9f7979a-e308-4952-bd0c-b160a6950601 req-08632411-2dd2-4378-ac3b-b97303b825aa tempest-TestMinimumBasicScenario-659011030 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-468f2646-1daf-493d-a48e-0a5e36e57a61', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': '468f2646-1daf-493d-a48e-0a5e36e57a61', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:41:58.716448 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-b9f7979a-e308-4952-bd0c-b160a6950601 req-08632411-2dd2-4378-ac3b-b97303b825aa tempest-TestMinimumBasicScenario-659011030 None] Connection info returned from driver {'name': 'volumes/volume-468f2646-1daf-493d-a48e-0a5e36e57a61', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '468f2646-1daf-493d-a48e-0a5e36e57a61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '084ab6d1-0f06-40a8-966f-a90b827cc27c'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:41:58.767030 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-b9f7979a-e308-4952-bd0c-b160a6950601 req-08632411-2dd2-4378-ac3b-b97303b825aa tempest-TestMinimumBasicScenario-659011030 None] attachment_update completed successfully. Jan 15 21:42:41.373355 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:42:41.374026 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:42:41.403808 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:42:41.447867 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:43:16.855149 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-daf3205d-6bce-4448-8410-f179e4e81f33 req-47b8bf99-3c88-41c2-abd0-1b7c0f90420b tempest-TestMinimumBasicScenario-659011030 None] Terminate volume connection completed successfully. Jan 15 21:43:16.855846 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-daf3205d-6bce-4448-8410-f179e4e81f33 req-47b8bf99-3c88-41c2-abd0-1b7c0f90420b tempest-TestMinimumBasicScenario-659011030 None] Deleting attachment 084ab6d1-0f06-40a8-966f-a90b827cc27c. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:43:17.377474 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] Lock "b'cinder-468f2646-1daf-493d-a48e-0a5e36e57a61-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:43:17.407029 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:43:17.449412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:43:17.449886 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] Volume volume-468f2646-1daf-493d-a48e-0a5e36e57a61 is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:43:17.454544 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] deleting rbd volume volume-468f2646-1daf-493d-a48e-0a5e36e57a61 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:43:17.646476 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] Created reservations ['1303dd77-be8a-4bab-8807-f86d81f6ec68', 'af6800c6-b8b6-408c-a1a2-b2e71a2ab1bf', 'a9ded41e-5121-4c25-9add-28dec8ebcb06', 'febbe29e-2d7d-4ede-b950-b52c59549061'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:43:17.686899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:43:17.708638 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:43:17.731397 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:43:17.735513 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] Deleted volume successfully. Jan 15 21:43:17.748180 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-26369db7-372d-435b-b5c9-6e29ac72575c tempest-TestMinimumBasicScenario-659011030 None] Lock "b'cinder-468f2646-1daf-493d-a48e-0a5e36e57a61-delete_volume'" released by "delete_volume" :: held 0.371s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:43:41.373211 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:43:41.373993 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:43:41.402251 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:43:41.429750 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:44:41.377006 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:44:41.381323 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:44:41.437513 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:44:41.512660 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:45:41.379762 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:45:41.380431 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:45:41.402024 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:45:41.424406 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:46:41.380198 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:46:41.380899 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:46:41.406443 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:46:41.431107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:47:41.376372 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:47:41.377127 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:47:41.401174 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:47:41.427951 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:48:41.373569 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:48:41.374375 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:48:41.397730 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:48:41.420081 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:49:41.377027 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:49:41.377750 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:49:41.399323 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:49:41.421729 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:50:41.378693 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:50:41.379385 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:50:41.400227 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:50:41.422529 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:51:41.379506 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:51:41.380224 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:51:41.401792 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:51:41.424443 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:52:41.381226 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:52:41.381885 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:52:41.403164 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:52:41.426806 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:53:41.382460 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:53:41.383107 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:53:41.404430 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:53:41.426684 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:54:41.382644 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:54:41.383322 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:54:41.404884 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:54:41.426154 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:55:38.590796 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=122725) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1341}} Jan 15 21:55:38.594727 ncdv-master-1 cinder-volume[122725]: WARNING stevedore.named [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jan 15 21:55:38.595209 ncdv-master-1 cinder-volume[122725]: WARNING castellan.key_manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jan 15 21:55:38.615300 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Flow 'volume_create_manager' (315a5dcb-c0de-4e64-91be-f031e1538dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:55:38.622569 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8516b3-f4d7-47c7-90d7-453802940e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:55:38.631400 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_db.sqlalchemy.engines [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 15 21:55:38.646904 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8516b3-f4d7-47c7-90d7-453802940e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-01-15T21:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1815512323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e04f580c-dee4-4337-af0b-330444326234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbeb500a7e84c5d8f6c765ef6530484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-01-15T21:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-01-15T21:55:39Z,use_quota=True,user_id='cd71ca21ce8c455a92db914d0c7e622f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8306164-c84c-4922-ad4f-280887ec0a56),volume_type_id=c8306164-c84c-4922-ad4f-280887ec0a56)' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:55:38.652587 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24618082-aa46-44b7-a309-085c030b067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:55:38.656749 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24618082-aa46-44b7-a309-085c030b067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:55:38.662144 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a500f1c-36f0-403b-9ed3-447f4dbfeda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:55:38.740393 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a500f1c-36f0-403b-9ed3-447f4dbfeda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e04f580c-dee4-4337-af0b-330444326234', 'volume_name': 'volume-e04f580c-dee4-4337-af0b-330444326234', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:55:38.746341 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c832f0-30ef-42e4-8f01-09efaeadb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:55:38.750465 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c832f0-30ef-42e4-8f01-09efaeadb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:55:38.755208 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b14f9fc-0960-448a-86a4-5242812f61a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:55:38.756342 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Volume e04f580c-dee4-4337-af0b-330444326234: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e04f580c-dee4-4337-af0b-330444326234', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jan 15 21:55:38.756940 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Cloning e04f580c-dee4-4337-af0b-330444326234 from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 at location (None, None). {{(pid=122725) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1046}} Jan 15 21:55:38.764729 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:55:38.774791 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 55, 38, 769493)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:55:38.775438 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:55:38.775850 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Found cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:869}} Jan 15 21:55:38.779798 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Lock "b'cinder-1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 21:55:38.780676 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Attempting to retrieve cache entry for image = 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 on host ncdv-master-1@ceph#ceph. {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:810}} Jan 15 21:55:38.786159 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Found image-volume cache entry: {'id': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'volume_id': '3796de7d-2057-45ab-912d-cdbf04b3cdcf', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11), 'last_used': datetime.datetime(2022, 1, 15, 21, 55, 38, 784057)}. {{(pid=122725) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jan 15 21:55:38.786580 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.image.cache [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Image-volume cache entry image_update_at = 2022-01-15 20:40:11+00:00, requested image updated_at = 2022-01-15 20:40:11+00:00. {{(pid=122725) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jan 15 21:55:38.786977 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Creating from source image-volume 3796de7d-2057-45ab-912d-cdbf04b3cdcf {{(pid=122725) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:824}} Jan 15 21:55:38.798507 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:55:38.848585 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] creating snapshot='volume-e04f580c-dee4-4337-af0b-330444326234.clone_snap' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:725}} Jan 15 21:55:38.962086 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] cloning 'volume-3796de7d-2057-45ab-912d-cdbf04b3cdcf@volume-e04f580c-dee4-4337-af0b-330444326234.clone_snap' to 'volume-e04f580c-dee4-4337-af0b-330444326234' {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:731}} Jan 15 21:55:39.095727 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Volume volume-de865fb1-204c-482c-a650-62332e1f854e.deleted is not a clone. {{(pid=122725) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1125}} Jan 15 21:55:39.096976 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:860}} Jan 15 21:55:39.105270 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=122725) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:869}} Jan 15 21:55:39.117346 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] clone created successfully {{(pid=122725) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:803}} Jan 15 21:55:39.118012 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.volume_utils [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Marking volume e04f580c-dee4-4337-af0b-330444326234 as bootable. {{(pid=122725) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Jan 15 21:55:39.125142 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Copying metadata from image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 to e04f580c-dee4-4337-af0b-330444326234. {{(pid=122725) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:443}} Jan 15 21:55:39.125739 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Creating volume glance metadata for volume e04f580c-dee4-4337-af0b-330444326234 backed by image 1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=122725) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:666}} Jan 15 21:55:39.174363 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b14f9fc-0960-448a-86a4-5242812f61a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04f580c-dee4-4337-af0b-330444326234', 'volume_size': 1, 'image_id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77e72f57799d458ca3f41cece754301d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815', 'created_at': datetime.datetime(2022, 1, 15, 20, 39, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 1, 15, 20, 40, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c5bb2aa-aad4-45bb-ba0f-7fcb289e6815/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:55:39.179852 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e89ff5b-474d-4a4b-be98-2161fab7e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jan 15 21:55:39.187653 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.flows.manager.create_volume [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Volume volume-e04f580c-dee4-4337-af0b-330444326234 (e04f580c-dee4-4337-af0b-330444326234): created successfully Jan 15 21:55:39.191144 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e89ff5b-474d-4a4b-be98-2161fab7e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=122725) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jan 15 21:55:39.197406 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Flow 'volume_create_manager' (315a5dcb-c0de-4e64-91be-f031e1538dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=122725) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jan 15 21:55:39.204361 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [None req-95f42fe2-9ca1-45aa-909a-250511156f06 tempest-TestShelveInstance-623147722 None] Created volume successfully. Jan 15 21:55:41.382409 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:55:41.383154 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:55:41.433487 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:55:41.461345 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:55:41.482094 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-81e78028-79be-46d9-917f-1e3b0bb84f77 req-2b94ec36-8375-4d91-bdd2-650ead593c9f tempest-TestShelveInstance-623147722 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:55:42.171470 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-81e78028-79be-46d9-917f-1e3b0bb84f77 req-2b94ec36-8375-4d91-bdd2-650ead593c9f tempest-TestShelveInstance-623147722 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.689s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:55:42.172298 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-81e78028-79be-46d9-917f-1e3b0bb84f77 req-2b94ec36-8375-4d91-bdd2-650ead593c9f tempest-TestShelveInstance-623147722 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e04f580c-dee4-4337-af0b-330444326234', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'e04f580c-dee4-4337-af0b-330444326234', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:55:42.196423 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-81e78028-79be-46d9-917f-1e3b0bb84f77 req-2b94ec36-8375-4d91-bdd2-650ead593c9f tempest-TestShelveInstance-623147722 None] Connection info returned from driver {'name': 'volumes/volume-e04f580c-dee4-4337-af0b-330444326234', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e04f580c-dee4-4337-af0b-330444326234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd6fdcc1b-2124-48c2-bc49-453aabd5c4b2'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:55:42.251151 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-81e78028-79be-46d9-917f-1e3b0bb84f77 req-2b94ec36-8375-4d91-bdd2-650ead593c9f tempest-TestShelveInstance-623147722 None] attachment_update completed successfully. Jan 15 21:56:41.379623 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:56:41.380629 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:56:41.406572 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:56:41.432151 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:57:41.378749 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:57:41.379486 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:57:41.401601 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:57:41.424079 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:58:14.055825 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-e29f8870-2e16-4d56-b24f-541cde6eaa48 req-a0d6933a-053b-4d45-a656-2a5b63258a34 tempest-TestShelveInstance-623147722 None] Terminate volume connection completed successfully. Jan 15 21:58:14.056514 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-e29f8870-2e16-4d56-b24f-541cde6eaa48 req-a0d6933a-053b-4d45-a656-2a5b63258a34 tempest-TestShelveInstance-623147722 None] Deleting attachment d6fdcc1b-2124-48c2-bc49-453aabd5c4b2. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:58:15.757075 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-eb097651-a371-4967-a46d-8aeb9d40df11 req-f86981eb-ab1f-4fae-bbdd-b42360067191 tempest-TestShelveInstance-623147722 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 15 21:58:16.409503 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_concurrency.processutils [req-eb097651-a371-4967-a46d-8aeb9d40df11 req-f86981eb-ab1f-4fae-bbdd-b42360067191 tempest-TestShelveInstance-623147722 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=122725) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 15 21:58:16.410637 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-eb097651-a371-4967-a46d-8aeb9d40df11 req-f86981eb-ab1f-4fae-bbdd-b42360067191 tempest-TestShelveInstance-623147722 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e04f580c-dee4-4337-af0b-330444326234', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '53efa32e-6408-4d4a-b019-3d2f51bdcfea', 'volume_id': 'e04f580c-dee4-4337-af0b-330444326234', 'discard': True}} {{(pid=122725) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1527}} Jan 15 21:58:16.432561 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-eb097651-a371-4967-a46d-8aeb9d40df11 req-f86981eb-ab1f-4fae-bbdd-b42360067191 tempest-TestShelveInstance-623147722 None] Connection info returned from driver {'name': 'volumes/volume-e04f580c-dee4-4337-af0b-330444326234', 'hosts': ['10.222.0.46'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e04f580c-dee4-4337-af0b-330444326234', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7e6ff67e-d5c0-43ae-b921-175dd18186c9'} {{(pid=122725) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4812}} Jan 15 21:58:16.475826 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-eb097651-a371-4967-a46d-8aeb9d40df11 req-f86981eb-ab1f-4fae-bbdd-b42360067191 tempest-TestShelveInstance-623147722 None] attachment_update completed successfully. Jan 15 21:58:41.379310 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:58:41.380159 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:58:41.407889 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:58:41.430374 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:59:41.375637 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 21:59:41.376348 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:59:41.398450 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:59:41.421139 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:59:49.002352 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-0e5554c6-d908-4f05-89ed-8fad7810c9a4 tempest-TestShelveInstance-623147722 None] Terminate volume connection completed successfully. Jan 15 21:59:49.002914 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.manager [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-0e5554c6-d908-4f05-89ed-8fad7810c9a4 tempest-TestShelveInstance-623147722 None] Deleting attachment 7e6ff67e-d5c0-43ae-b921-175dd18186c9. {{(pid=122725) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4948}} Jan 15 21:59:49.118973 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] Lock "b'cinder-e04f580c-dee4-4337-af0b-330444326234-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Jan 15 21:59:49.149716 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:59:49.220528 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] volume has no backup snaps {{(pid=122725) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1102}} Jan 15 21:59:49.226549 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] deleting rbd volume volume-e04f580c-dee4-4337-af0b-330444326234 {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1245}} Jan 15 21:59:49.483375 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] volume is a clone so cleaning references {{(pid=122725) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1266}} Jan 15 21:59:49.525939 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] deleting parent snapshot volume-e04f580c-dee4-4337-af0b-330444326234.clone_snap {{(pid=122725) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1158}} Jan 15 21:59:50.046971 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.quota [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] Created reservations ['9eee4080-5b70-4ef3-9706-94b4bfc055aa', '8b9ddfb5-80ed-456d-9eb4-5391f31f515a', '8fd64d2f-1dfe-4c91-a491-62a2a2def947', '3c9d954c-b49d-495e-8099-6290bc68f549'] {{(pid=122725) reserve /opt/stack/cinder/cinder/quota.py:755}} Jan 15 21:59:50.087988 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:59:50.111200 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 21:59:50.135124 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 21:59:50.139387 ncdv-master-1 cinder-volume[122725]: INFO cinder.volume.manager [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] Deleted volume successfully. Jan 15 21:59:50.151720 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.coordination [req-453bdaa5-498f-43c1-b1e7-02a54c165ae7 req-4c8f6311-3ec9-4645-bc59-003bf81b0240 tempest-TestShelveInstance-623147722 None] Lock "b'cinder-e04f580c-dee4-4337-af0b-330444326234-delete_volume'" released by "delete_volume" :: held 1.033s {{(pid=122725) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Jan 15 22:00:41.377565 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:00:41.378280 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:00:41.400059 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:00:41.422284 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:01:41.377897 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:01:41.378553 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:01:41.400596 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:01:41.422347 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:02:41.379414 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:02:41.379922 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:02:41.421751 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:02:41.460581 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:03:41.377302 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:03:41.378004 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:03:41.400130 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:03:41.422066 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:04:41.377594 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:04:41.378736 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:04:41.403678 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:04:41.429057 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:05:41.374775 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:05:41.375540 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:05:41.397416 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:05:41.419839 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:06:41.375741 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:06:41.376415 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:06:41.397995 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:06:41.419800 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:07:41.374889 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:07:41.375556 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:07:41.396724 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:07:41.419749 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:08:41.374343 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:08:41.374996 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:08:41.395969 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:08:41.418635 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:09:41.373971 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:09:41.374627 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:09:41.395783 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:09:41.418584 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:10:41.375732 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:10:41.376412 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:10:41.397160 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:10:41.418898 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:11:41.374713 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:11:41.375403 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:11:41.397848 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:11:41.420373 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jan 15 22:12:41.375396 ncdv-master-1 cinder-volume[122725]: DEBUG oslo_service.periodic_task [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=122725) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jan 15 22:12:41.376061 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:12:41.398390 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.volume.drivers.rbd [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=122725) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:481}} Jan 15 22:12:41.420414 ncdv-master-1 cinder-volume[122725]: DEBUG cinder.manager [None req-805fb3bd-6efb-479e-843c-52060856f27f None None] Notifying Schedulers of capabilities ... {{(pid=122725) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}